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Abstract 

Supermassive black holes (SMBH) lurk in the nuclei of most massive galaxies, perhaps 
in all of them. The tight observed scaling relations between SMBH masses and structural 
properties of their host spheroids likely indicate that the processes fostering the growth of 
both components are physically linked, despite the many orders of magnitude difference in 
their physical size. This chapter discusses how we constrain the evolution of SMBH, probed 
by their actively growing phases, when they shine as active galactic nuclei (AGN) with 
luminosities often in excess of that of the entire stellar population of their host galaxies. 
Following loosely the chronological developments of the field, we begin by discussing early 
evolutionary studies, when AGN observed at various wavelengths represented beacons of 
light probing the most distant reaches of the universe and were used as tracers of the large 
scale structure ("Cosmography"). This early study turned into a more mundane enterprise of 
AGN "Demography" , once it was realized that the strong evolution (in luminosity, number 
density) of the AGN population hindered any attempt to derive cosmological parameters 
from AGN observations directly. Following a discussion of the state of the art in the study of 
AGN luminosity functions, we move on to discuss the "modern" view of AGN evolution, one 
in which a bigger emphasis is given to the physical relationships between the population of 
growing black holes and their environment ( "Cosmology" ) . This includes observational and 
theoretical efforts aimed at constraining and understanding the evolution of scaling relations, 
as well as the resulting limits on the evolution of the SMBH mass function. Physical models 
of AGN feedback and the ongoing efforts to isolate them observationally arc discussed next. 
Finally, we touch upon the problem of when and how the first black holes formed and the 
role of black holes in the high-redshift universe. 
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1 A historical perspective on AGN research 

The study of astrophysical black holes, as it has developed over the last five decades, is driven 
by three main rationales and goals. Because the mere existence of black holes is the most 
far-reaching implication of the theory of General Relativity (together with the Big Bang cos- 
mological theory), they can first of all be used to test theories of gravitation in the strong field 
regime. Secondly, astrophysical black holes are revealed to us through emission processes taking 
place in accretion flows and relativistic jets, both originating in the black hole's deep potential 
well, and they offer a unique opportunity of studying interesting and complex astrophysical 
problems, involving extreme physical conditions, relativistic magnetohydrodynamics, and ra- 
diative effects. Thirdly, black hole formation and evolution might play an important role in a 
broader cosmological context, affecting the formation and the evolution of the structures they 
live in, such as galaxies, groups and clusters. 

During the first golden age 3 of black hole astrophysics, efforts were focused on finding proof of 
the existence of black holes and to define their basic interactions with the environment (accretion 



lr This definition was introduced by the Caltech graduate Bill Press l|Thornel .ll994) to identify the years between 
the early '60s and the early '70s. 
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Figure 1: The local black hole mass function, plotted as M x 0m in order to highlight the location 
and height of the two main peaks in the distribution. The stellar mass black hole peak has been 
drawn assuming a log-normal distribution with mean mass equal to 5 solar masses, width of 0.1 
dex a nd a normalization yielding a density of about 1.1 x 10 7 M & Mpc -3 ( Fukugita Peebles! . 
20041 ). which is about 7 x 10 -5 times the critical density of the universe. The supermassive black 
hole peak, instead, contributes to an overall density of about 4.2 x 10 5 Mq Mpc -3 , or a fraction 
only 2.7 x 10~ 6 of the critical density (see section I3TT1 for details). 



and relativistic jet theory). Such goals only touched on the first two of the rationales listed above. 
The history of the development of black hole physics (both theoretical and observational) in these 
years has been beautifully lai d out by Kip Thorne in his book "Black Holes and time warps: 
Einstein's outrageous legacy" ( Thorne . 19941 ). where the reader can find a more complete set of 
references and biographical notes, together with the historical accounts presented elsewhere in 
this volume (see E. Perlman: "Active galactic nuclei"). 

Beginning at about the turn of the 21st century, black hole astrophysicists have acknowledged 
the relevance of their subject of study for a broader community of cosmologists and extragalactic 
astronomers, thanks to the multiple lines of evidence pointing towards a fundamental role played 
by black holes in galaxy evolution. 

In fact, black holes in the local universe come in two main families according to their size, 
as recognized by the strongly bi-modal distribution of the local black hole mass function (see 
Fig. [1]). While the height, width and exact mass scale of the stellar mass peak should be 
understood as a by-product of stellar (and binary) evolution, and of the physical processes 
that make supernovae and gamma-ray bursts explode, the supermassive black hole peak in this 
distribution is the outcome of the cosmological growth of structures and of the evolution of 
accretion in the nuclei of galaxies, likely modulated by the mergers these nuclear black holes 
will experience as a result of the hierarchical galaxy-galaxy coalescences. 
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This picture of the local demographics of black holes has been made possible by the dis- 
covery of tight scaling relations between the central black hole mass and various properties of 
their host spheroids (velocity dispersion, cr*, stel lar mass, M*, luminos i ty, etc.) that charac- 
terize the structure of nearby inactive galax i es (Magorrian et al. 1998 ; Gebhardt et al. 2000l : 



Ferrarese fc Merrittlbood : lHaring fc RixlboO i ; iGiiltekin et alj|2009l . see Figure EJ. 



These correlations are a result of the search for local QSO relics via the study of their 
dynamical influence on the surrounding stars and gas made possible by the launch of the Hubble 
Space Telescope. They have revolutionized the way we understand the physical link between the 
evolution of galaxies and active galactic nuclei (AGr\H). 

In addition, it is now understood that supermassive black hole (SMBH) growth is due mainly 
to radiatively efficient accretion over cosmological times, taking place during active phases (see 
§ 13.11 below). This, together with the understanding of a near universal presence of black holes 
in galactic centers has led to the suggestion that most, if not all, galaxies went through a 
phase of nuclear activity in the past, during which a strong physical coupling (generally termed 
"feedback") might have established a long-lasting link between host and black hole properties. 

Such a renewed interest for AGN in a cosmological context requires a good understanding 
of the evolutionary properties of this class of objects. The fact that AGN and quasars were a 
strongly evolving class of astronomical sources became evident very soon after their discovery, 
as we will discuss at length in the following sections. Nonetheless, the appreciation that such 
an evolution could not only mirror, but also influence that of galaxies, groups and clusters, only 
became commonplace after the discovery of the above mentioned scaling relations. 

In this chapter we will focus on the current knowledge of AGN evolution. Following loosely 
the chronological developments of the field, we will begin by discussing the "first generation" of 
AGN evolutionary studies (§[2|), during which AGN observed at various wavelengths represented 
beacons of light probing the most distant reaches of the universe and were used as tracers of the 
structures themselves. 

This short-lived epoch of AGN "Cosmography" quickly gave way to a more mundane en- 
terprise of AGN "Demography" , once it was realized that the strong evolution (in luminosity, 
number density, etc.) of the AGN population hindered any serious attempt to derive cosmolog- 
ical parameters from AGN observations directly. The attention then moved to the study of the 
evolution of active galactic nuclei by means of determinations of their luminosity functions. An 
update on the most recent works on the luminosity functions of AGN selected in different ways 
from different electromagnetic bands will also be given in section [2j which will be closed by a 
brief discussion of AGN clustering as a natural complementary cosmographic tool (§ 12. 2\i . 

We will then move to discuss the "modern" view of AGN evolution, one in which a bigger 
emphasis is given to the physical relationships between the population of growing black holes and 
their environments. We call this the "Cosmology" phase of AGN studies, to highlight the close 
link between these subject areas that has been established in recent years. We will first discuss 
observational and theoretical efforts aimed at constraining and understanding the evolution of 
the scaling relations, as well as the resulting limits on the evolution of the SMBH mass function 



2 In this chapter, we will use both the term AGN and QSO/quasar to indicate actively growing supermassive 
black holes, implying no real physical distinction between the two, apart from one based on the total emitted 
luminosity: while AGN can be used for any objects, QSO/quasar usually identify those with bolometric luminosity 
log Lboi > 46 in cgs units. 
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Figure 2: The Mbh — c* relation for galaxies with dynamical BH mass measurements. The 
symbols indicate the method of BH mass measurement: stellar dynamical (pentagrams), gas 
dynamical (circles), masers (asterisks). Arrows indicate 3a confidence upper limits to the BH 
mass. The color of the error ellipse indicates the Hubble type of the host galaxy: elliptical 
(red), SO (green), and spiral (blue). The saturation of the colors in the error ellipses or boxes 
is inversely proportional to the area of the ellipse or box. Squares are galaxies not included 
in the fit. This is shown as a solid line for the best fit relation to the full sample: Mbh = 
10 8 - 12 M (<7*/2OO km s" 1 ) 4 ' 24 (adopted from iGiiltekin et aLlbood v 



5 



(§ E]), and we will then present physical models of AGN feedback and the ongoing efforts to 
isolate them observationally in section [H 

Finally, in the last section of this chapter (§ ED we will touch upon the problem of when and 
how the first black holes form and the role of black holes in the high redshift universe. 

Before all this, however, a small diversion is in place. To be consistent, the very notion of 
an evolutionary study of any particular class of objects, not only in astrophysics, requires a 
definition of the non-evolving substratus that allows us to first identify an object as a member of 
the class, the evolution of which one wishes to study. To make just a simple example drawn from 
astronomical research, the evolution of galaxies is very much complicated by the never-ending 
morphological and photometric transformation of the different populations, so that a non-trivial 
element of any such study is the identification of progenitors and offspring along the Hubble 
sequence (see the Chapter R. Buta: "Galaxy Morphology" in this volume). 



1.1 Redshift evolution in AGN Spectral Energy Distributions 



The overall spectral energy distribution (SED) of AGN extends over many decades in frequency, 
and is the result of a number of different emission processes acting at different physical scales. 
We refer the reader to Chapter "Active Galactic Nuclei" by E. Perlman in this book for a 
thorough discussion of these processes and of the main characteristic of AGN SED. 

The observational appearance of an active galactic nucleus is determined not only by its 
intrinsic emission properties, but also by the nature, amount, dynamical and kinematic state 
of any intervening material along the line of sight. AGN obscuration is a crucial factor for our 
general understanding of the AGN phenomenon. For example, in the traditional unification- 
by-orientation schemes different classes of AGN are explained on the basis of the li ne-of-sight 
orien t ation with respect to t he axis of rotational symmetry of the system (see e.g. lAntonucci 
19931 ; lUrrv fc Padovanilll995l . and references therein). 

At odds with such simple schemes, evidence for a var iation of the fraction of obscured AGN 
as a function of luminosity has been mounting r ecently (jlJeda et all 1200.4 ISteffen et all 1200.4 
Simpson . 2005 ; Hasinger . 20081 ). The fraction of absorbed AGN, defined in different and often 
independent ways, appears to be lower at higher nuclear luminosities. This might be considered 
a signature of AGN feedback (in the "quasar" mode, see § !4.6l below). in that powerful sources are 
able to clean up their immediate gaseous environments, responsible for the nuclear obscuration, 
more efficiently. 

After accounting for such a clear luminosity-dependence, it is currently unclear whether the 
overall incidence of obscuration and extinction in the nuclear regions of a galaxy evolve with 
redshift. This would be expected if, for example, nuclear obscuration were causally linked to 
the overall amount of gas within galaxies, a quantity that increases obviously with redshift. 

What we are interested in here, however, is any possible evidence of redshift evolution (or 
lack thereof) of the intrinsic AGN spectral properties, i.e. those characterizing the emission 
processes associated with the major mode of radiative energy release. 

X-ray emission is ubiquitous in AGN, and is a very effective way for selecting accreting black 
holes due both to the minimal contamination of star-forming processes and due to the decreasing 
importance of obscuration at increasing X-ray energies. Unfortunately, the exact mechanism 
responsible for AGN X-ray emission and its physical location are not fully understood yet (see 
Chapter "Active Galactic Nuclei" by E. Perlman in this book). Still, as a very general diagnostic, 
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Figure 3: Left: a ox residuals as a function of redshift (top panel) and luminosity density at 
2500 A (bottom panel). The overlaid error bars denote the mean and the 3a standard deviation 
of the mean of the residuals. Limits are denoted with arrows. The systematic re siduals in the 
lower plot indicate that a ox cannot be dependent on redshift alone (adopted from lSteffen et all 
20061 k Right: X-ray photon index (T) vs. redshift z. Blue circles represent radio quiet, non-BAL 



(Broad Absorption Line) quasars, green stars represent radio loud quasars, and red triangles 
represent BAL quasars. The bottom plot shows the weighted mean T values for bins of width 
Az = 1. No clear sign of evolution in the avera ge X-ray spectral s lope of AGN is detected over 
more than 90% of the age of the universe (from Young et al. 20091 ). 



the "X-ray loudness", usually characterized by the a ox parameter, i.e. the slope of the spectrum 
between 2500 A = 5 eV and 2 keV: a ox = 0.3838 log(-F2kcv/-^250o) can be used to characterize 
the fraction of bolometric light carried away by high-energy X-ray photons. Recent studies of 
large samples of both X-ray and optical s elected AGN have clearly demonstrat ed that a ox is 
itself a function of UV luminosity (see e.g. Steffen et al. 2006 : Young et al. 20091 ). However, no 
redshift evolution can be discerned in the data, as shown in the left panel of Figure [3l 

Moreover, large collecting- area X-ray telescopes allow a more precise determination of the X- 
ray spectra of AGN, which are usually characterized by a power-law, upon which emission lines 
and absorption features are superimposed. Up to the highest redshift where reliable spectral 
analysis of AGN can be performed, no clear sign of evolution in the X-ray spectral slope V has 
been detected (see the right panel of Figure [3]) . 

Similarly, while the narrow iron Ka emission line, the most prominent feature in AGN X-ray 

spect ra, is clearly dependent on luminosity (the so-called Iwasawa-Taniguchi effect llwasawa fc Taniguchi 
19931 ). it s hows no sign of evoluti on in its equivalent width with redshift, at least up to z ~ 1.2 



(Figure HI IChaudharv et al.ll2010i . and references therein). 

Even more surprising is the lack of evolution in the optical emission line properties of QSOs. 
The metallicities implied by the relative strength of broad emission lines do not show any 
significant reds hift evolution: They are solar or super-solar, even in the highest redshift QSOs 
known (see e.g. Hamann Sz Ferland 19921 ). in contrast with the strong evolution of the metallicity 
in star forming galaxies. 
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Figure 4: Rest frame equivalent width of the narrow Iron Ka emission line observed in the 
average spectrum of AGN as a function of redshift. Only obj ects in a fixed (2-10 keV ) luminosity 
range 10 43,5 < L2-10 < 10 44 ' 5 ergs/s were considered. From Chaudhary et al. 2010l . 



A pictorial view of this surprising uniformity is shown in the left panel of figure El where 
the raw spectra from ~ 17,000 QSOs extracted from the Sloan Digital Sky Survey (SDSS) are 
plotted next to each other in a sequence of increasing redshift from bottom to top. The right 
panel of Fig. [ 5] sho ws a direct comparison of stacked QSO spectra in three redshift intervals 
(j.Tuarez et allraOOfll ). where it is clear that the flux ratios among the most prominent lines stay 
almost constant up to the highest redshift probed. 

Summarizing, there exists a remarkably uniform set of spectral characteristics that defines 
active nuclei at all epochs in the history if the universe, at least if we consider objects of a 
fixed total (bolometric) luminosity. The simplest explanation is that the emission properties 
from AGN, i.e., those which are (in most cases, at least) set by physical processes taking place 
within the gravitational sphere of influence of the central black hole, are essentially dictated by 
the gas and plasma dynamics there, where the central object's gravity dominates. We should 
then expect them to be relatively insensitive to the cosmological epoch, which instead greatly 
affects the properties of matter (density, temperature, ionization state, etc.) at the generic outer 
boundary, i.e., right outside the SMBH gravitational sphere of influence. 



2 Cosmography and Demography 

Accreting supermassive black holes have long been the lighthouses of our observable universe, 
holding the record of the most distant object known for more than four decades. As such, they 
have played a key role in the early phases of cosmological investigations. 

Already in 1955 the second Cambridge catalog (2C) of unresolved radio sources (the so-called 
'radio stars') observed at 81 MHz (3.7 meters) had shown both a remarkable uniformity in the 
distribution of objects in the sky a nd an increase in the cumulative number counts (see below) 
that allowed iRyle fc Scheuerl (119551 ) to unambiguously demonstrate not only their extragalactic 
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Figure 5: Left: Spectra of 17,000 QSOs from SDSS. Notice the large degree of uniformity in 
the relative intensity of the main emission features (courtesy of X. Fan); Right Stacked spectra 
of quasars in different redshift bins. Note that the relative intensity of the metal lines (and in 
particular the (SiIV+OIV])/CIV ratio) remains constant over the wide redshift interval 2.5jzj6.4, 
indicating that the metallicity in the observed quasars does not evolve with redshift. From 
Juarez et alJ l|200g| ). 



origin, but also that the bulk of the source should lie at distances larger than a few tens of Mpc, 
i.e. well beyond the edge of the optically observable universe at the time. 

The dispute over the exact shape of the radio source number count distribution that ensued 
soon afterwards became a key part of the debate between "steady state" and "evolutionary" 
models of the universe, lending strong support against station ary universe models (see Figure [6|). 
Just two years after the discovery of quasars (jSchmidti . fl~963h with their exceedingly large red- 
shifts, A. Sandage wrote: "The objects would seem to be of major importance in the solution of 
the cosmological problem. They can be found at great distances because of their high luminosity. 
Studies of the [number counts] curves using [qu asars] should eventually provide a crucial test 
of various cos mological model s " (jSandagd . Il965l ) . Similar hopes were expressed by Longair the 
following year ( Longair . 19661 ). 

However, as we will discuss in more detail in the following sections, quasars and radio galaxy 
source counts demonstrated clearly that the populations being studied did evolve strongly with 
cosmic epoch: the number of quasars per unit comoving volume was clearly larger in the past, 
so that the information about the geometry of the universe and the cosmological parameters is 
buried underneath that about the evolution of the AGN themselves. 

Progress in characterizing the intrinsic evolution of the QSO population effectively quenched 
the hope to use black holes as ideal tracers of the structure of the universe, but opened up the 
study of the evolution of growing supermassive black holes, that we outline below. 



2.1 From Number Counts to Luminosity Functions 

By number counts one typically means the surface density in the sky of a given class of sources as 
a function of the limiting flux of the observations. In astronomy, this is the simplest observational 
tool that can be used to study the evolution of a sample of objects (and to test cosmological 
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Figur e 6: Observed norma lized radio number counts from the original 3C catalog at 178 MHz 
(from iRvle &: Clarkd Il96ll ). The observational points (open circles) are extrapolated at low 
fluxes with three empirical models (i,h, and iii) made such as not to violate the total low- 
frequency radio background available at the time. Dashed lines marked with (a) and (b) denote 
the counts predicted by the steady state cosmological model assuming two possible luminosity 
functions, given the observed sources. A clear discrepancy emerged between observations and 
non-evolving universe models. A more detailed discussion of current constraints on radio sources 
number counts is given in section [2. 1.1 1 
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models). 

The space density of sources of different intrinsic luminosities, L, is described by the lumi- 
nosity function (LF), (fr(L), so that dN = <j>{L)dL is the number of sources per unit volume 
with luminosity in the range L to L + dL. Let us, for simplicity, consider the local or nearby 
(Euclidean) universe uniformly filled with sources with LF <f>{L). If S is the limiting flux that 
we can detect, sources with luminosity L can be observed out to a distance r = (L/47rS) 1//2 . 
The number of sources over the solid angle fi, observable down to the flux S are: 

N{> S) = j ^DdL = 3^5"^ / L^(L)dL . (1) 

Thus, independent of the exact shape of the luminosity function entering in the determination 
of a normalization constant, the slope of the cumulative number counts of any non-evolving class 
of sources in a uniform, Euclidean universe should always be equal to dlogiV(> S)/d\ogS = 
—3/2 (if we use magnitudes, m, instead of luminosities, then dlog N(> m)/dm = 0.6). 

In general, the correct relativistic expression for number counts differs from the Euclidean 
one because (a) the observed flux density depends upon the spectrum of the source, as the 
radiation emitted at frequency v\ is observed at the redshifted frequency vq = v\/(l + z), 
and (b) curvature effects modify the volume element per unit redshift, making it smaller with 
increasing z. Overall, for typical source spectra which are not too strongly "inverted" (i.e. with 
flux density increasing with frequency), the combination of these effects makes it more and 
more difficult to detect sources at progressively higher reds hift and cause s number counts to 



have slopes always shallower than the Euclidean one (see e.g. lLongairll2008l . chapter 17). As we 
will see below, strong evolutionary effects (i.e. luminosity functions changing rapidly with time) 
can counteract such a behavior. 

Before proceeding, a brief introduction of common terminology widely adopted in the study of 
luminosity function evolution is necessary. The simplest general approach describes an evolving 
luminosity function with the aid of two functions, f\{z) and fd(z), that take into account the 
evolution of the luminosity and number density of the sources, respectively: 

<P(L,z) = f d (z) ( f>(L/f l (z),z = 0). (2) 

In the pure luminosity evolution (PLE) case (/d =const.), the co-moving number density 
of sources is constant, but luminosity varies with cosmic epoch; in the pure density evolution 
(PDE) case (f\ =const.), but the co-moving density of sources of any luminosity varies. 

In the following sections we will discuss the observational state of the art as far as AGN 
number counts and luminosity functions are concerned, in the radio, X-rays and optical/IR 
bands. More comprehensive and s pecialized reviews ha ve, of course, been published. In particu- 
lar, we refer to the recent work b y lde Zotti et aT ( 2010l ) fo r a discussion of observatio ns at radio 



wavelengths, Croom et al. ( 20091 ) for optical QSOs and to Brandt Sz Hasinger ( 20051 ) for X-ray 
studies. 

2.1.1 The evolution of radio AGN 

Figure [7] shows a compilation of cumulative sou rce number counts f rom a large number of 
surveys in different radio bands (data points from IMassardi etaDboiol . see references therein). 
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On the bottom x-axis, the total radio flux is expressed as Sr = vS v (where S u is the observed 
radio flux density at any given radio frequency v) in cgs units, while the top axis shows the 
corresponding radio flux density at 1.4 GHz. Overall, the shape of the radio counts is similar 
in all bands, indicating the relative lack of spectral complexity of radio AGN. This is best seen 
when normalizing the observed counts to the Euclidean slope, as shown in the top panel. 

At bright fluxes, counts rise more ste eply than S~ 3 ^ 2 . This was already discovered by the 



first radio surveys at meter wavelengths (IRyle Sz Scheuerl . Il955l ). as we have discussed above 



lending strong support for evolutionary cosmological models, as opposed to theories of a steady 
state universe (see Fig. [6]). 

At fluxes fainter than about a JanskjH (or ~ 10~ 14 ergs s" 1 cm" 2 at 1 GHz) the counts 
increase less steeply than 5~ 3 / 2 , being dominated by sources at high redshift, thus probing a 
substantial volume of the observable universe. 

At flux densities above a mJy the population of radio sources is largely composed by AGN. 
For these sources, the observed radio emission includes the classical extended jet and double 
lobe radio sources as well as compact radio components more directly associated with the energy 
generation and collimation near the central engine; 

The deepest radio surveys, however, (see e.g. Padovani et al. 20091 and references therein), 



probing well into the sub-mJy regime, clearly show a further steepening of the counts. The 
nature of this change is not completely understood yet, but in general it is attributed to the 
emergence of a new class of radio sources, most likely that of star-forming galaxies and/or radio 
quiet AGN. Unambiguous solutions of the population constituents at those faint flux levels 
requires not only identification of the (optical/IR) counterparts of such faint radio sources, but 
also a robust understanding of the physical mechanisms responsible for the observed emission 
both at radio and optical/IR wavelengths. 

Thus, the complex shape of the observed number counts provides clues about the evolution 
of radio AGN, as well as on their physical nature, even before undertaking the daunting task 
of identifying substantial fractions of the observed sources, determining their distances, and 
translating the observed density of source s in the redshift-luminosity plane into a (evolving) 
luminosity function. Pioneering work from lLongairl (Il96fih already demonstrated that, in order 



to reproduce the narrowness of the observed 'bump' in the normalized counts around 1 Jy seen 
in Fig. [7J only the most luminous sources could evolve strongly (in density and/or luminosity) 
with redshift. This was probably the first direct hint of the intimate nature of the differential 
evolution AGN undergo over cosmological times. 

Indeed, many early investigations of high redshift radio luminosity functions (see, e.g., 



Danese et al.lll987l ) demonstrated that neither PLE nor PDE models could explain the observed 



evolution of radio sources, with more powerful sources (often of FRII morphology ) displaying a 



far m ore dramatic rise in their number densities with increasing redshift (see also IWillott et al 



I2001I 1 



Trying to assess the nature of radio AGN evolution across larger redshift ranges requires 
a careful evaluation of radio spectral properties of AGN. Steeper synchrotron spectra are pro- 
duced in the extended lobes of radio jets, while flat spectra are usually associated with compact 
cores. For objects at distances such that no radio morphological information is available, the 
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A Jansky (named after Karl Jansky, who first discovered the existence of radio waves from space) is a flux 
measure, corresponding to 10 -23 ergs cm -2 Hz -1 
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Figure 7: A compilation of cumulative radio source counts (number of objects brighter than 
a given flux per squ are degree) in various bands. The observational data are taken from 
(jMassardi et al.ll2O10l see also references therein). On the bottom horizontal axis the total radio 
flux = vS v in CGS units is shown, while the top horizontal axis shows the corresponding flux 
density in Jansky, where v\a is the frequency of 1.4 GHz. The bottom panel shows the observed 
counts, while the top panel shows the counts after the Euclidean slope has been factored out. 
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Figure 8: The radio view of AGN downsizing. Left Best fit number densit y evolution of radio 
sources of different power, taken from the models of Massardi et al. ( 20ld ). for steep and flat 
spectrum sources in the left and right panels, respectively. Right: Evolution of the comoving 20 
cm integrated luminosity density for VLA-COSMOS AGN (orange curve) galaxies for z < 1.3. 



Also shown is the evolution of the high-luminosity radio AGN, adopted from (jWillott et al.H2001 



hatched region; the thick and dashed lines correspond to the mean, maximum and minimum 
results, respectively). The evolution for the total AGN population, obtained by co-adding the 
VLA-COSMO S and high luminos ity AGN energy densities, is shown as the red-shaded curve 
(adopted from lSmolcic et aLll2009l ). 
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combination of observing frequency, K-corrections, intrinsic source variability and orientation of 
the jet with respect to the line of sight may all contribute to severe biase s in the determin ation 



of the co- moving number densities of sources, espec ially at high redshif t (IWall et all 120051 ), 



In a very extensive and equally influential work iDunlop &: Peacock! (jl990l ) studied the evo- 
lution of the luminosity functions of steep and flat spectrum sources separately. They showed 
that the overall redshift evolution of the two classes of sources were similar, with steep spectrum 
sources outnumbering flat ones by almost a factor of ten. Uncertainties remained regarding the 
possibility of a high-redshift decline of radio AGN number densities. The issue is still under 
discussio n, with the most clear evidence for such a decline observed for flat-spectrum radio QSO 
at z > 3 ( Wall et all 20051 ). consistent with the most recent findings of optical and X-ray surveys 
(see also § [5] below) . 

Under the simplifying assumption that the overall radio AGN population can be sub-divided 
into steep and flat spectrum sources, characterized by a power-law synchrotron spectrum oc 
v~ a , with slope «fl a t = 0.1 and a stC ep = 0.8, respectively, a redshift dependent luminosity 
function can be derived for the two populations separately, by fitting simple models to a very 
large and comprehensive set of data on multi- frequency source counts and redshift distributions 



obtained by radio surveys at v < 5 GHz (jMassardi et allkoid ). The comoving number densities 



in bins of increasing radio power (at 1.4 GHz) from the resulting best fit luminosity function 
models are shown in the left panel of Figure El 

Radio AGN, both with steep and flat spectrum, show the distinctive feature of a differential 
density evolution, with the most powerful objects evolving more strongly towards higher redshift, 
a phenomenological trend that, in the current cosmologist jargon, is called "downsizing". 

Recent radio observational campaigns of large multi-wavelength sky surveys have also cor- 
roborated this view, by providing a much mo re detailed picture of low luminosity radio AGN. 
For example, the work of Smolcic et al. ( 20091 ) on the COSMOS field showed that radio galaxies 
with Li.4QHz < few x 10 25 WHz -1 evolve up to z ~ 1, but much more mildly than their more 
luminous counterparts, as shown in the right panel Figure El 



2.1.2 X-ray surveys and the resolution of the X-ray background 

As already mentioned, active galactic nuclei are pow erful X-ray emitters. The discovery of the 
intense cosmic X-ray background radiation (CXRB; Giacconi et al. . 19621 ) in the early 1960's 
opened up a privileged window for the study of the energetic phenomena associated with accre- 
tion onto black holes. 

Due to the relative weakness of X-ray emission from stars and stellar remnants (magnetically 
active stars, cataclysmic variables and, more importantly, X-ray binaries are the main stellar X- 
ray sources), the X-ray sky is almost completely dominated by the evolving SMBH population, 
at least down to the faintest fluxes probed by current X-ray focusing telescopes. The goal of 
reaching a complete census of evolving AGN, and thus of the accretion power released by SMBH 
in the history of the universe has therefore been intertwined with that of fully resolving the 
CXRB into individual sources. Accurate determinations of the CXRB intensity and spectral 
shape, coupled with the resolution of this radiation into individual sources, allow very sensitive 

tests of how the AGN luminosity and obscuration evolv e with redshift. i 

" 20091 ) 



New generations of synthesis models of the CXRB (jGilli et all 120071 : iTreister et al 



have quickly followed the publication of increasingly larger and deeper surveys (for the current 
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Figure 9: A smoothed, false color image of the deepest X-ray exposure to date, the 4 x 10 6 
second Chandra observation of the Chandra Deep Field South (CDFS). These observations 
resolve almost the entire CXRB radiation below ~ 5 keV into individual sources, the vast 



majority of which are accreting supermassive black holes. From lXue et alJ (l201ll ). 
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deepest view of the X-ray sky, see Figure [9]). Figure [TUI shows a rec ent compilation of th e CXRB 
measurements together with one incarnation of a synthesis model (jTreister et all 120091 ) of AGN 
evolution that explains those data. The hard slope of the background spectrum (well described 
by a power-law with photon index Tcxrb — 1.4 at < 10 keV) and the prominent peak at 
about 30 keV are accounted for by assuming that the majority of active galactic nuclei are in 
fact obscured. 

These new models have progressively reduced the uncertainties in the absorbing column 
density distribution. When combined with the observed X-ray luminosity functions, they provide 
an almost complete census of the Compton thin AGN (i.e., those obscured by columns Ah < 
ovp 1 ~ 1.5 x 10 24 cm" 2 , where cjt is the Thomson cross section). This class of objects dominates 
the counts in the lower energy X-ray e nergy band, where al most the entire CXRB radiation has 
been resolved into individual sources (jWorslev et all l2005h . It should be noted, however, that 
at the peak energy of the observed CXRB radiation only a small fraction (less than 5%) of the 
emission has so far been resolved into individual objects. 

CXRB synthesis models, like the one shown in Figure [10] ascribe a substantial fraction of 
this unresolved emission to heavily obscured (Compton Thick) AGN. However, because of their 
faintness even at hard X-ray energies, their redshift and luminosity distribution is essentially 
unknown, and even their absolute contribution to the overall CXRB sensitively depends on the 
quite uncertain normalization of the unresolved emission at hard X-ray energies. The quest 
for the physical characterization of this "missing" AGN population, most likely dominated by 
Compton thick AGN, represents one of the last current frontiers of the study of AGN evolution 
at X-ray wavelengths. 

Putting together the observational data from a large suite of complementary surveys, Fig- 
ure [11] shows a compilation of X-ray number counts, for both soft (0.5-2 keV) and hard (2-10 
keV) selected samples. 

Given the steep frequency dependence of photo-electric absorption cross sections, the harder 
the energy band probed the less affected by obscuration the objects under study are. Current 
technologies provide the best compromise between telescope effective area and energy range in 
the 2-10 keV band. Indeed, the density of AGN detected in this band is higher than that of 
0.5-2 keV selected ones, by at least a factor of 3. 

As for the radio log A- log S of Fig. the counts become shallower than the Euclidean slope 
at intermediate fluxes (about 10~ 14 ergs s" 1 cm" 2 ), where the largest relative fraction of the 
CXRB is produced. Tentative evidence of a steepening at the lowest fluxes might indicate the 
emergence of a different, non-AGN, population of star-forming galaxies whose X-ray emission is 
primarily due to stars and stellar remnants. 

The deepest surveys so far carried out in the soft X-ray energy range (0.5-2 keV), sup- 
plemented by the painstaking work of optical identification and redshift determination of the 
detected sources have provided the most accurate description of the overall evolution of the 
AGN luminosity function. Neither PLE nor PDE provide a satisfactory description of the X-ray 
LF evolution, with a good fit to the data achieved with a "Luminosity D ependent Density Evq - 
lution" (LDDE) model, or variations thereof. In their influential work, lHasinger et al.l (]2005l ) 
unambiguously demonstrated that in the observed soft X-ray energy band more luminous AGN 
peaked at higher redshift than lower luminosity ones (see Fig. [T2|) . 

A good enough sampling of the luminosity redshift plane necessary for accurate LF studies 
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Figure 10: Observed spectrum of the extragalactic CXRB from HE AO 1, Chandra, XMM- 
Newton, INTEGRAL, and Swift data. The solid (red, blue, and black) thin lines show the con- 
tribution to this model from unobscured, obscured Compton-thin, and Compton Thick AGNs, 
respectively. The thick black solid and dashed grey lines are two different CXRB spectral models 
proposed in the literature depending on the assumed normalization of the HE AO 1; the main 
difference is the number of Compton Thick AGNs, which is redu ced by a factor of 4 if the black 
solid line is assumed instead of the dashed one. Adopted from iTreister et al.l (fcoOfll ). where a 
complete list of references of the data points shown is presented. 
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Figure 11: A compilation of cumulative X-ray source counts (number of objects brighter than 



a given flux per square degree) in the soft (0.5-2 keV, cyan-blue colors) and hard 
red-orange colors) ban ds. The observation al data are taken from ICappelluti et al 



(2-10 keV, 
_ (|2009h (see 

references therein) and Mateos et al. ( 20081 ). The bottom panel shows the observed counts, while 
the top panel shows the counts after the Euclidean slope has been factored out. 
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Figure 12: The soft X-ray view of AGN downsizing: (a) The space density of AGNs as a function 
of redshift in different luminosity classes and the sum over all luminosities with log L x ^ 42. 
Densities from the PLE and LDDE models are over-plotted with solid lines, (b) The same 
as (a), except that the soft X-ray emissivities are plotted instead of number densities. The 
uppe rmost curve (black) s hows the sum of emissivities in all luminosity classes in the plot. 
From Hasinger et al. ( 20051 ). 
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requires more extensive observational efforts in the hard X-ray band, as obscured AGN are 
more difficult to identify (and to obtain redshifts for) in the optical band. Nonetheless, the 
general "downsizing" trend illustrated by the soft-X-ray selected AGN of Fig. [T2] ha s so far been 



confi rmed by almost all recent studies of (2-10 keV) X-ray selected AGN (see e.g. lUeda et al 

20oah . 



2.1.3 Optical and Infrared studies of QSOs 

Bright AGN emit a large fraction of their bolometric luminosity in the optical/UV part of the 
spectrum (see Chapter "Active Galactic Nuclei" by E. Permian in this volume). For Eddington 
ratios (A = Lboi/^Eddi where LeoM = 47tGMbh?'%>c/ot — 1.3 x 10 38 (A/bh/-^o) ergs s _1 is the 
Eddington luminosity) larger than a few per-cent, the AGN light out-shines the emission from 
the host galaxy, resulting in point-like emission with peculiar blue colors. 

Finding efficient ways to select QSO in large optical surveys, trying to minimize contamina- 
tion from stars, white dwarfs and brown dwarfs has been a primary goal of optical astronomers 
since the realization that QSO were extragalac tic objects often lying at cosmological distances 
(jSchmidt Greenl . Il983l : iRichards etail l200d ) . 



Optical surveys remain an extremely powerful tool to uncover the evolution of unobscured 
QSOs up to the highest redshift {z ~ 6). In terms of sheer numbers, the known population 
of SMBH is dominated by such optically selected AGN (e.g. more that 10 5 QSOs have been 
identified in the Sloan Digital Sky Survey), essentially due to the yet unsurpassed capability of 
ground-based optical telescopes to perform wide-field, deep surveys of the extra- galactic sky. 

Figure [TBI shows a compilation of (g-band, ~ 470(M) quasar number counts from the largest 
recent optical surveys (2SLAQ, 2QZ, and SDSS), for objects in the redshift range 0.3 < z < 2.2. 
The overall shape is similar to that of the radio AGN counts, with a steep increase at bright 
fluxes, followed by a turnover at around g ~ 19. A comparison with Figures [71 and [TT1 reveals, 
however, that such large area QSO surveys reach depths corresponding to a number density of 
sources in the sky more than one order of magnitudes smaller that those probed by the deepest 
X-ray and radio surveys. 

Thus, the dominant AGN population eludes systematic detection in optical surveys. In gen- 
eral terms, the difficulty of optical QSO surveys to probe deep into the AGN population is due 
to two major effects: the first one is the already mentioned issue of nuclear obscuration, dramat- 
ically affecting the UV/optical appearance of AGN; the second is galaxy dilution of the AGN 
light (and of the broad emission line signature often used to select quasars). More specifically, 
let us consider an A GN with B-band lum inosity given by .Lagn,b = ALEdd/B, with bolometric 
correction /b ~ 0.1 ( Richards et al. . 20061 ). Assuming a bulge-to-black hole mass ratio of 0.001 



and a bulge-to-total galactic stellar mass ratio of (B/T), the contrast between nuclear AGN 
continuum and host galaxy blue light is given by: 

-^AGN.B _ A (M*/£g_)hoSt (Dlrp} /o\ 

L host)B 0.1 3(M /L ) 1 1 ] U 

Thus, for typical mass-to-light ratios, the AGN will become increasingly diluted by the host 
stellar light at Eddington ratios A smaller than a few per cent. 

High-spatial resolution observations of the nu merically d ominant population of Low-Luminosity 
AGN (LLAGN; see the comprehensive review of Ho 20081 . and references therein) have so far 



21 



g 

23 22 21 20 19 18 17 16 15 14 



Q0 
T3 



100 - 



00 
CO 

V 



10 - 



10.00 r 



S° 1.00 

T3 



r-l — l — l — l — l — l — l — l — l — | — l — l — l — l — l — l — l — l — l — | — l — l — l — l — l — l — l — l — l — | 'l 'l l — l — l — l — l — l — t-. 

□ 2SLAQ ; 
a 2QZ 

• SDSS DR3 




\ 



GO 

V 

5 o.io t- 



0.01 r 



_i i i i i i i i i I i i i i i i i i i I i i i i i i i i i i nn i i i i i i i 



•14 



■13 -12 -11 

Log S [erg s cm -8 ] 



10 



Figure 13: Compilation of (g-band, ~ 4700A) quasar number counts from the largest recent 
optical surveys at 0.3 < z < 2.3 (2SLAQ, 2QZ and SDSS, courtesy of G. Richards and S. Croom). 
g-band magnitudes have been converted into CGS flux units (S g ) with logS^ = — 0.4(<? — 20) — 
12.64. 
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only been possible in the very local universe. At higher redshift, the deepest multi-wavelength 
AGN/galaxy surveys to date are starting to probe AGN luminosities such that the contribution 
of the host galaxy to the overall SED cannot be neglected. This compromises the efficiency and 
"cleanness" of AGN selection at optical/IR wavelength, but opens up the possibility of studying 
the connection between nuclear black hole activity and host galaxy properties. We will come 
back more extensively in section [3721 to the issue of the overall decomposition of the AGN-galaxy 
spectral energy distribution in large multiwavelength surveys. 

As for the general evolution of the optically selected QSO luminosity function, it has been 
known for a long time that luminous QSOs were much more common at high redshift (z ~ 2). 
Nevertheless, it is only with the aid of the aforementioned large and deep surveys covering a 
wide enough area of the distance-luminosity plane that it was possible t o put sensible const raints 
on the character of the observed evolution. The most recent attempts ( Croom et al. . 20091 ) have 
shown unambiguously that optically selected AGN do not evolve according to a simple PLE, but 
instead more luminous objects peaked in their number densities at redshifts higher than lower 
luminosity objects, as shown in the left panel of Figure [T4"l 

We close this section with a brief discussion of the current status of IR AGN LF studies. 

According to the AGN unification paradigm, obscuration comes from optically thick dust 
blocking the central engine along some lines of sight. The temperature in this structure, which 
can range up to 1000K (the typical dust sublimation temperature), and the roughly isotropic 
emission toward longer wavelengths should make both obscured and unobscured AGNs very 
bright in the mid- to far-infrared bands. This spectral shift of absorbed light to the IR has 
allowed sensiti ve mid-infrared obse rvatories (IRAS, ISO, Spitzer) to deliver large numbers of 
AGN (see, e.g. iTreister et all l2006h . 

Traditionally, the problem with IR studies of AGN evolution, however, lies neither in the 
efficiency with which growing supermassive black holes can be found, nor with the completeness 
of the AGN selection, which is clearly high and (almost) independent of nuclear obscuration, but 
rather in the level of contamination. IR counts are, in fact, dominated by star forming galaxies at 
all fluxes. This, and the lack of clear spectral signatures in the nuclear, AGN-powered emission in 
this band, implies that secure identification of AGN in any IR-selected catalog often necessitates 
additional information from other wavelengths, usually radio, X-rays, or optical spectroscopy. 

Indeed, unlike the case of the CX RB, AGN contr i bute only a small fraction (up to 2-10%) of 
the cosmic IR background r adiation dTreister et all lioOfih , and similar fractions are estimated 



for the contribution of AGN at the "knee" of the total IR luminosity function at all redshifts. 
Nonetheless, tremendous progres s has been achieved in recent years, thanks to more refined 



mid-IR color-color selection criteria ([Stern et all 120051 ) which are little affected by contamina- 



tion, and provide reliable AGN samples, albeit with some well understood completeness biases 
against AGNs that are faint with respect to their hosts, and z 4.5 Type 1 AGNs. 

Thus, deep surveys with extensive multi- wavelength co verage can a l so be used to track the 
evolution of active galaxies in the mid-infrared (see, e.g. Assef et al. . 201 ll ). Strengthening 



similar conclusions discussed above from other wavelengths, IR-selected AGN do not appear to 
evolve following either the PLE or PDE parametrizations, but require significant differences in 
the evolution of bright and faint sources, with the number density of the former declining more 
steeply with decreasing redshift than that of the latter (see the right panel in Figure [1] 
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Figure 14: Left: The combined 2SLAQ and SDSS optical QSO luminosity function plotted as 
a function of redshift for different absolute g band magnitude intervals (the brightest at the 
bottom of the plot and the faintest at the top). The measured LF is compared to the best fit 
PLE model (dotted lines), smooth LDDE model (long dashed lin es) and LADE (Lum inosity 
And Density Evolution) model (short dashed lines). Adopted from ( Croom et al. . 20091 ): Right: 
J-band luminosity function of mid-IR-selected AGN for several redshift bins. The crosses show 
points that were not used in the fits. The best-fit LADE, PLE, and pure PDE models are 
shown by the solid, dashed, and dotted line, respectively, although only the LADE model is 
an acceptable fit to the data. The shaded area shows the 2<r confidence region for the LADE 
fit. For reference, the solid light gr ay line show s the b est-fit LADE model to a sample from a 
combined IR/X-ray selection. From lAssef et al.l (|201ll ). 
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Figure 15: A compilation of luminosity functions observed in various energy bands. The log- 
arithm of the number of AGN per unit comoving volume and unit logarithm of luminosity is 
plotted as a function of the observed luminosity (in solar units). Observational points for IR 
(15//m; filled red squares), B-band (filled blue circles), soft- (0.5-2 keV; empty blue triangles) and 
hard- X-rays (2-10 keV; empty purple triangles) are shown alongside published analytic fits for 
each band (solid lines in corre sponding colors) . The best fit radio luminosity functions of steep 
and flat spectrum sources from lMassardi et all (|2O10l ) are also shown for comparison with orange 
and red thick lines, respectively. The observed mismatch among the various luminosity functions 
in Fig. [15] is due to a combination of different bolometric corrections and incompleteness due to 
obscuration. Courtesy of P. Hopkins 
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Figure 16: Left: The redshift evolution of the bolometric en e rgy d ensity for AGN selected in 
different bands. Bolometric corrections from Hopkins et al, ( 20071 ) have been used, and the 



shaded areas represent the uncertainty coming from the bolometric corrections only. Right: 
The fraction of AGN missed by observations in any specific band as a function of the intrinsic 
bolometric luminosity of the AGN. Red, light blue, dark blue and purple shaded areas correspond 
to rest-frame mid-IR (15/zm), UV (B-band), soft X-rays (0.5-2 keV) and hard X-rays (2-10 
keV) , respectively. The uncertainty on the missed fractions depend on the uncertainties of the 
bolometric corrections and on the shape of the observed luminosity functions only. 



2.1.4 Bolometric Luminosity functions 



We have seen in the previous sections how a qualitatively consistent picture of the main features 
of AGN evolution is emerging from the largest surveys of the sky in various energy bands. 
Strong (positive) redshift evolution of the overall number density, as well as marked differential 
evolution (with more luminous sources being more dominant at higher redshift) characterize the 
evolution of AGN. 

Fundamental constraints on the physical evolution of the accretion-powered emission over 
cosmological times, like the ones we will discuss later in §0 require, ideally, a good knowledge 
of the bolometric luminosity function of AGN. This, in turn, demands a detailed assessment of 
selection biases and a robust estimation of the AGN Spectral Energy Distribution (SED). 

A thorough and detailed understanding of the AGN SED as a function of luminosity (and, 
possibly, of redshift, but see section [TTT1 above) could in principle allow us to compare and cross- 
correlate the information on the AGN evolution gathered in different bands. As f or the accuracy 



of our knowledge of the bolometric correction, we re fer the reader to the studies of lMarconi et al 



(|2004l ): iRichards et al.l (|200d ): lHopkins et all (120071 ) . All of them consistently demonstrate that 
a luminosity dependent bolometric correction is required in order to match type I (unabsorbed) 
AGN luminosity functions obtained by selecting objects in different bands. 

Summarizing the discussion of the previous sections, Figure [15] shows a compilation of lu- 
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minosity functions observed at various wavelengths. The observed mismatch among the various 
LF observed at all redshift is due to a combination of different bolometric corrections and in- 
completeness due to obscuration. In fact, adopting a general form of luminosity-dependent 
bolometric correction, and wit h a relatively s i mple par ametrization of the effect of the obscura- 
tion bias on the observed LF, Hopkins et al. ( 20071 ) were able to project the different observed 
luminosity functions in various bands into a single bolometric one, 0(Lbol) (Figure [17]) . As a 
corollary from such an exercise, we can then provide a simple figure of merit for AGN selection 
in various bands by measuring the bolometric energy density associated with AGN selected in 
that particular band as a function of redshift. We show this in the left panel of Figure [16] for 
four specific bands (hard X-rays, soft X-rays, UV, and mid-IR). From this, it is obvious that the 
reduced incidence of absorption in the 2-10 keV band makes the hard X-ray surveys recover a 
higher fraction of the accretion power generated in the universe than any other method. 

While optical QSO surveys miss more than three quarters of all AGN of any given Lboi, 
hard X-ray selection only fails to account for about one third (up to 50%) of all AGN, the most 
heavily obscured (Compton Thick) ones, as shown in the right panel of Figure [TBI A common 
feature apparent from such a figure is that the effects of obscuration appear to be more severe 
at lower intrinsic luminosities, an observational fact that has been discussed previously in the 
context of X-ray surveys of AGN (see section [Tj] above). It is important to note that the high 
missed fraction for mid-IR selected AGN is a direct consequence of the need for (usually optical) 
AGN identification of the IR sources, so that optically obscured active nuclei are by and large 
missing in the IR AGN luminosity functions considered here. 

Figure [18] shows the evolution of the parameters of the analytic fit to the bolometric LF 
data. They encompass our global knowledge of the evolution of accretion power onto nuclear 
black holes throughout the history of the universe. The three bottom panels reveal the overall 
increase in AGN activity with redshift, up to z ~ 2, and the mirroring high-redshift decline. At 
the center, the total integrated luminosity density evolution mark the epochs of rapid build-up of 
the SMBH mass density. On the lower left, the evolution in the break luminosity -Lboi,* indicates 
that the "typical" accreting black holes was significantly more luminous at z ~ 2 than now, a 
different way of looking at AGN "downsizing" . This is accompanied by a progressive steepening 
of the faint end slope of the LF (upper left panel): low- luminosity AGN become more and more 
dominant in the overall number density of AGN as time progresses. 

Such a detailed view of the evolution of active galactic nuclei, with its distinctive signatures 
of "downsizing" , has lent additional support to the notion that the lives of growing black holes 
must be intimately linked to those of their host galaxies. Indeed, both galaxies and black holes 
show signs of a sim ilar differential evolution. The very term "downsizing" was first used by 
Cowie et al. (jl996l ) to describe the finding that actively star-forming galaxies at low redshift 



have smaller masses than actively star- forming galaxies at z ~ 1. It has come to identify, in the 
current cosmology jargon, a variety of possibly distinct phenomena, not just related to the epoch 
of star formation, but also to that of star formation quenching, or galaxy assembly (see Chapter 
"Galaxies in the Cosmological Context" by G. De Lucia in this same volume). Our current 
understanding of AGN evolution, encapsulated in the observable evolution of their bolometric 
luminosity function, emphatically suggests that growing nuclear black holes take part in this 
global process of structure formation. 
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Figure 1 7: Bolometric AGN lu minosity function (gray band) as a function of redshift, as calcu- 
lated by iHopkins et al.l (|2007l ) . The different symbols and colors refer to different bands from 
which data have been extracted: solid blue circles are optical data, filled red squares IR (at 15 
/jm), blue and purple triangle are soft and hard X-ray data, respectively, and the filled orange 
diamonds are luminosities from em ission lines. The vert ical dashed lines bracket the observa- 
tional limits. We refer the reader to Hopkins et al. ( 20071 ) for a more detailed description of the 
data and methodology used to extract the bolometric luminosity function. Data points courtesy 
of P. Hopkins 
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Figure 18: Best-fit AGN bolometric LF double power-law parameters as a function of redshift. 
Symbols show the best-fit values to data at each redshift, dotted lines the best-fit PLE model, 
and solid lines the best-fit full model (a luminosity and density evolution one). Although PLE 
is appropriate for a lowest order fit, both the bright- and faint-end slopes evolve with redshift to 
high significance. The bottom right panel shows the predicted number d ensity of bright optica l 
quasars from the full fit (solid line), compared to that observed ones. From lHopkins et al. I <|2007h . 
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2.2 AGN Clustering and the Large scale structure of the universe 

The bolometric luminosity function of AGN provides the basic tool to describe the differential 
evolution of growing black holes. Some key properties of AGN, however, remain impossible to 
determine on the sole basis of the observed LF. As it is increasingly difficult to measure black 
hole masses at high redshift, and currently only possible for bright, un-obscured broad line QSOs, 
we do not have robust, direct, observational constraints on the distribution of AGN Eddington 
ratios beyond the local universe. The Eddington ratio distribution, in turn, depends on the 
details of the average AGN lightcurves which could reveal important details of the physical 
processes driving the accreting gas towards the black hole. 

The spatial distribution of QSOs (clustering) in the sky could provide such an alternative 



method to estimate lifetimes ([Martini &: Weinbergll200ll : see also Chapter "Large scale structure 



of the universe" by A. Coil in this volume). In the current ACDM paradigm for structure 
formation, more clustered objects are rarer and live in more massive dark matter structures (or 
"halos"). Thus, if AGN are strongly clustered, their hosts must be rare objects, too, and the 
effective AGN lifetime must be long, in order for such a rare "parent" population to account for 
the total AGN luminosity density observed. If, on the other hand, their clustering is comparable 
to the clustering of smaller, less massive, dark matter halos, their host are more common and 
their luminous phases must therefore have short duration. 

A commonly used technique for measuring the spatial clustering of a class of objects is the 
two-point correlation function £(r), which measures the excess probability dP above a random 
distribution of finding an object in a volume element dV at a distance r from another randomly 
chosen object: 

dP = n[l + £{r)]dV (4) 

where n is the mean number density of objects. In the scale range between a few tens of kpc 
and a few tens of Mpc, for most classes of astronomical objects £(r) can be described by a single 
power-law: 

«W=(^)" 7 (5) 

where tq is the correlation, or clustering, length, defined as the scale at which the two-point 
correlation function is equal to unity. 

Unfortunately, a direct comparison of the measured clustering length of AGN with that 
expected for dark matter halos of different masses is hampered by the fact that, according to 
current theories of structure formation, galaxies (and their nuclear black holes) do not follow 
the distribution of the underlying matter, but form in the high-density peaks of the dark matter 
field. The bias of any astrophysical population X is defined as the (square root of the) ratio 
between the two-point autocorrelation functions of population X and of the dark matter (DM) 
halos: &x,dm(i") = v^xM/^dmM- 

Many groups have now been able to measure the cluster ing of AGN at different luminosities, 



bands, scales and redshifts (see, e.g., the recent review of IShankarl 120091 for a complete list of 
references). Overall, the clustering length of quasars appears to be an increasing function of 
redshift, but does not depend strongly on luminosity. 

As shown in Fig. [H?l the bias of optically selected (broad line) AGN increases with redshift 
following an evolution at approximately constant dark matter halo mass (since halos of a fixed 
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mass are progressively more clustered towards higher redshift), in the range logMoM — 12.5 -j- 
13h _1 M at redshifts z < 3.5. 

Instead, X-ray selected objects ( Allevato et al. . 201 ll ). both obscured and unobscured, reside 



in more massive DM structures at all redshifts z < 2.25, with a typical mass of the hosting halos 
constant over time in the range logM^yi — 13 -j- 13.5h~ Mq. 

By combining the number density of AGN with that of the hosting dark matter halos, one 
can estimate an AGN duty cycle, and a corresponding average lifetime. The observed biases of 
the rare, luminous broad lined quasars imply timescales of the order of 10 7 -rT0 8 years, increasing 
with redshift, as the massive halos typically hosting AGN become increasingly rare. 

For X-ray selected AGN, a larger duty cycle is inferred, which translates into an AGN lifetime 
of ~ 0.1 -7- 1 Gyr, about one order of magnitude longer than that estimated for optically bright 
QSOs at the same redshift. This is mainly due to the higher number density and higher bias of 
AGN found in X-ray selected samples. 

Numerical simu lations of merger- induced AGN activity in a cosmological context have shown 
dBonoli et all l2009h that the clustering of optically selected quasars is well explained by a model 
in which these objects are triggered by major merger events. The difference between optically 
selected and the (lower-luminosity) X-ray selected AGN of Figure [19] might suggest that X-ray 
selected AGN are triggered by different (secular) processes which may be capable of fueling 
luminous AGN in the gas-rich environment of star- forming galaxies at high redshift. The same 
models also predict an increase in AGN duty cycle for the brightest quasars at halo masses 
larger than 10 12 M & , but fail to reproduce the large biases for less luminous X-ray selected AGN 
at z ~ 1, possibly pointing (again) towards the need for a larger variety of AGN triggering 
mechanisms for this class of objects. 



3 Cosmology I: The growth of supermassive black holes in galax- 
ies 

As we have discussed in the previous section, the strong cosmological evolution of the quasar 
population was recognized early on by observers in essentially all bands of the electromagnetic 
spectrum. In the early 1990s, deep optical surveys of star-forming galaxies began to probe the 
cosmological evolution of the rate at which stars are formed within galaxies, thus providing 
robust constraints for models of galaxy formation and evolution (the so-called Lilly-Madau plot; 
Madau et aDll996h . It was soon clear that QSOs luminosity density and Star Formation Rate 
(SFR) density evolved in similar fashion , being much higher in the past, with a possible (very 
broad) peak at z « 2 feoyle & Terlevichl . 1 199a ). 

In the previous section we have traced the history of the study of AGN luminosity functions in 
various spectral bands, closing with an assessment of our current understanding of the bolometric 
luminosity function evolution. A reliable census of the bolometric energy output of growing 
supermassive black holes (see, e.g., the central bottom panel of Figure [T8|) allows a more direct 
estimate of the global rate of mass assembly in AGN, and an interesting comparison with that 
of stars in galaxies. Together with the tighter constraints on the "relic" SMBH mass density in 
the local universe, /0bh,o> provided by careful application of the scaling relations between black 
hole masses a nd host spheroids, this enables meaningful tests of the classical 'Soltan argument' 
(jSoltanl . 1 1982h . according to which the local mass budget of black holes in galactic nuclei should 
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Figure 19: Bias parameter as a function of redshift for various AGN surveys. The range of 
the bolometric luminosity probed is given in parenthesis: (i) optically selected BL AGN: green- 
crosses (2dF; 45.3 < logLboi < 46.7), green-stars (2dF; 45.5 < logLboi < 47.4), green-open 
squares (SDSS; 45.6 < logLboi < 46.9) and green-open triangles (SDSS; logLboi ~ 46.5); (ii) 
X-ray selected unobscured AGN: blue triangles and blue open-circles (XMM-COSMOS; 45 < 
logLboi < 45.7) and (iii) X-ray select ed obscured AGN: re c i squares and red crosses (XMM- 
COSMOS; 44.1 < logLboi < 44.6). See lAllevato et all (l201lh for a similar figure and the full list 
of references for the observed data points. The dashed lines show the expected bias evolution of 
typical DM halo masses. 
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be accounted for by integrating the overall energy density released by AGN, with an appropriate 
mass-to-energy conversion efficiency 

Many authors have carried out such a calculation, either using the CXRB as a "bolome ter" 
to derive the total energy density released by the ac cretion process (IFabian fc Iwasawal.ll999fl. or 



by considering evolving AGN luminosity functions (|Yu Tremaind . 12002 ; iMarconi et al.l . 12004 ; 



Merloni fe Heinz . 20081 ). Despite some tension among the published results that can be traced 
back to the particular choice of AGN LF and/or scaling relation assumed to derive the local 
mass density, it is fair to say that this approach represents a major success of the standard 
paradigm of accreting black holes as AGN power-sources, as the radiative efficiencies needed to 
explain the relic popul ation are within the range ~ 0.06-^0.20, predicted by standard relativistic 
accretion disc theory (INovikov fc ThorneL Il973l ) . 

In this section, we begin with a schematic account of the current constraints on the black 
hole mass density growth, and discuss some recent attempts to compare it on a quantitative 
level with the observed growth of the galaxy population. This will be followed by the (related) 
discussion of the possible evolution of the scaling relations. 



3.1 A global view of the accretion history of the universe 

Under the standard assumption that black holes grow mainly by accretion, their cosmic evolution 
can be calculated from the bolometric luminosity function of AGN <j)(L^ i,z), where L^ Q \ = 
e ra d-Mc 2 is the bolometric luminosity produced by a SMBH accreting at a rate of M with a 
radiative efficiency e ra< j. The non- negligible fraction of the AGN population which is unaccounted 
for in current surveys, the so-called Compton thick AGN (see §2.1.2l above). is usually included in 
the bolometric luminosity function by assuming a redshift-invariant column density distribution 
as measured in the very local universe and an overall number density of heavily obscured AGN 
that fits the CXRB. 

The total, integrated mass density in supermassive black holes can then be computed as a 
function of redshift: 

Pbh(z) _ n f z ^ Bn (z')d^ , 

dz' Zj 



1 



PBUfl 



o Pbh,o 



(6) 



where the black hole accretion rate (BHAR) density is given by: 



and 



^bh(z) 

dt 

dz 



[1 — e ra d)£ 



bol 



^radC 



4>(L hoh z)dL 



bol 



(7) 



(8) 



The exact shape of pbr( z ) and ^bu( z ) then depends only on the local black hole mass density 
Pbh,o and the (average) radiative efficiency e ra( j. 

We can then link the growth of SMBH fro m eq. © to the growth of stellar mass in galaxies. 
To do so, we will use the lHopkins et all (120071 ) bolometric LF of AGN (see section [2.1.41 above )R. 



4 As discussed in lMarconi et all (|2004T l. in order to correctly estimate the total bolometric output of an AGN, 
care sh ould be taken in avoi ding double counting of the IR reprocessed emission. This appears not have been 
done in iHopkins et"all (|2007T ). so we correct the bolometric luminosities by 30% to account for this. 
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Figure 20: Left: Evolution of the stellar mass density as a function of redshift (black points, 
observations), wh ere the density is given as a ratio to the local value, p*o = 5.6 x 10 8 M Q Mpc -3 



(Cole et al 



20011 ). Shaded areas represent 1-sigma confidence intervals of the model fits. Solid 
black line with purple shaded area shows the best joint fit from eq. (|9|) and eq. (fTUj) to both 
stellar mass and SFR density points (left and right panels), while the dot-dashed line with yellow 
shaded area marks the normalized evolution of the SMBH mass density only. The slight offset 
between the two is compensated by a change in the normalization of the average black hole 
to spheroid mass ratio with redshift (see text for details). The dashed (dotted) line with red 
(blue) shade d area shows the relative g rowth of the mass density in spher oids (discs). Va lues 
of A = 0.3 (jFukugita fc Peebles! . 12004 ) and /? B h,o = 4.2 x 1O 5 M Mpc~ 3 (|Shankarl . l200g| ) are 
adopted here. Right: The corresponding best-fit relation for the SFR density evolution, from 
eq. (|10p is shown with a solid line and dark blue shaded area. The dash-triple-dotted line is 
(1000 times) the black hole accretion rate density ^br(z) (BHAR). It appears that the BHAR 
declines slightly faster than the SFR, another way to emphasize the need of an evolution in the 
average Mbh/M^ ratio. 
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Because local SMBH are observed to correlate with spheroids only, we introduce the parameter 
\(z), the ratio of the mass in disks and irregulars to that in spheroids at any redshift, so that the 
total stellar mass density can be expressed as: p*(z) = p sp h(z) + Pdisk+irr^) = Psph(z)[l + ^( z )]- 
We can now assume that X(z) evolves according to X(z) = Aq(1 + z)~@ , where Ao is the 
value of the disk to spheroid mass density ratio in the local universe. Also, we assume that 
the mass density of spheroids and supermassive black holes evolve in parallel, modulo a factor 
(1 + z)~ a , obtaining a prediction for the observable stellar mass density evolution as traced by 
SMBH growth: 

p*(z) =A PBu(e^d,z)(l + z)- a [l + X (l + z)- ls } (9) 

where .Ao is the constant of proportionality in the SMBH mass-spheroid mass relation. By 
taking the derivative of eq. Q, accounting for stellar mass loss, an expression is also found for 
the corresponding star formation rate (SFR) density evolution: 

dp*(z)/dt = - f *^ z >) dx[At [ Z '- z)] ^dz>, (10) 

J Zi dt dz' 

where x[Ai(z' — z)\ is the fractional mass loss that a simple stellar population experiences after 
a time At (corresponding to the redshift interval (z' — z)j^ and z% is the redshift of (instanta- 
neous) formation of the first stellar populations; in practical terms, fixing any z% > 4 will not 
substantially alter the results of such kind of computations. 

With these expressions we fit observational data points of both p*(z) and SFR(z). For each 
choice of pbh,o> Ao, and of the critical accretion rate m cr , the fitting functions depend only on 
three parameters: a, f3 and the radiative efficiency e ra d- One example of su ch fits is shown 
i n Fig. [20] for the specific case p B H,o = 4.2 x 1O 5 M Mpc" 3 (jShankari . l2009h . and A = 0.3 
(jFukugita fc Peebles! . lioolh . 



Because the drop in the AGN integrated luminosity density at low z is apparently faster than 
that in the SFR density, the average black hole to spheroid mass ratio must evolve (slightly) 
with lookback time (a > 0). This result is independent of the local black hole mass density, 
and independent of Ao- For the particular example shown here, the average radiative efficiency 
turns out to be e ra d = 0.08^002 > while we obtain a = O.SSj^'g 2 (both shown with 3-cr confidence 
bounds). At face value, this would imply a very mild evolution of the average Mbh/MspIi mass 
ratio. We will discuss in section 13.2.11 how these constraints compare with recent efforts to 
directly measure the ratio of black hole to host galaxy mass at high redshift. 

This simple exercise should make clear that the available constraints on SMBH growth from 
the observed bolometric LF are robust enough to provide interesting non trivial insight into the 
cosmological co-evolution of AGN and galaxies. 



3.1.1 The Evolution of the SMBH mass function 

Despite the relative successes of 'Soltan argument '-like calculations of the integral evolution of 
the SMBH mass density, it is obvious that a much greater amount of information is contained 
in the differential distributions (mass and luminosity functions). We will now discuss attempts 
to use this information to constrain the evolution of the mass function of SMBH. 

5 An analogous term for pbh, due to the ejection of SMBHs from galaxy halos after a merger event, is much 
more difficult to estimate and is neglected here. 
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As opposed to the case of galaxies, where the direct relationship between the evolving mass 
functions of the various morphological types and the distribution of star forming galaxies is not 
straightforward due to the never-ending morphological and photometric transformation of the 
different populations, the situation in the case of SMBH is much simpler. For the latter case, 
we can assume their evolution is governed by a continuity equation ( Merloni <fe Heinz . 20081 . and 



references therein), where the mass function of SMBH at any given time can be used to predict 
the mass function at any other time, provided the distribution of accretion rates as a function 
of black hole mass is known. Such an equation can be written as: 



(^GM)(M0M)}) =0 (11) 



dt d/j, 

where /i = log M is the black hole mass in solar units, and ip{[i,t) is the SMBH mass function at 
time t. (M(/i, t)) is the average accretion rate of SMBH of mass M at time t and can be defined 
through a "fueling" function, F(fi,fj,,t), which describes the distribution of accretion rates for 
objects of mass M at time t 

{M(ji,t)) = [ MF(fi,fi,t)dfi (12) 



Such a fueling function is not a priori known, and observational determinations thereof have 
been possible in any robust sense only for the extremes of the overall population. However, 
the AGN fueling function can be derived by inverting the integral equation that relates the 
luminosity function of the population in question with its mass function. And so, we can write: 

</>(£, t) = J F{£ - C, (i, t)ij>{ji, t) d/i (13) 

with the definitions t = log Lbol an d C — log ( e radC 2 ), with e ra d the radiative efficiency, here 
assumed to be constant. 

Using this approach, eq. ([lip can be integrated backwards from z = 0, where we have 
simultaneous knowledge of both the mass function, ip(fi), and the luminosity function, 4>(£), 
thus evolving the SMBH mass function backwards in time, up to where (i) reliable estimates of 
the AGN luminosity functions are available, and (ii) the accumulated error in the mass function 
becomes of the order of the mass function itself. 

The first thing to notice from such an approach is that the different shapes of the ob- 
served SMBH mass function ifj(fi) (that decays exponentially at high masses) and AGN LF 
4>(£) (well describ e d by a double power-law) necessitate a broad distribution of accretion rate 



([Merloni Sz Heind . 120081 ): AGN, as a population, cannot be simply characterized by an on-off 
switch at fixed Eddington ratio. Instead, integration of eq. (jlip gives insight on the relative 
importance of massive black hole growth at different accretion rates. 

Figure [21] shows the number density evolution as a function of redshift for black holes of 
constant mass (in the range 8 < log(MBH/-^o) < 8.5) at different Eddington ratios. Numer- 
ically, the AGN population is always dominated by slowly accreting objects, but the observed 
flattening of the bolometric LF shape (see Fig. [T8[) implies that the relative number of rapidly 
accreting black holes increases significantly with redshift. In terms of grown mass, however, 
high-Eddington-ratio AGN strongly dominate the budget, as shown in the top panel of Fig. [2T1 
most of the mass of a typical « 1O 8 M black hole has been accumulated in (short-lived) episodes 
of rapid accretion, between a few and a few tens of per cent of the Eddington luminosity. 
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Figure 21: Bottom: Evolution of the number density (objects per comoving Mpc) as a function 
of redshift for black holes of constant mass (in the range 8 < log(A/BH/-^o) < 8.5) at different 
Eddington ratios. Solid (purple), dashed (blue), dot-dashed (green) and dotted (red) lines 
correspond to intervals of Eddington ratio ranging from 1 to 10 -3 ' 5 . Top: The product of 
average Eddington ratio times number density vs. redshift. Despite being numerically sub- 
dominant, rapidly accreting black holes (i.e., those with L/LEdd > 3%) clearly dominate the 
mass assembly of SMBH in this range of masses. 
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SMBH Growth Time 




Figure 22: Left: Average Growth time of Supermassive Black Holes (in years) as a function of 
redshift for different black hole mass ranges. The dashed line marks the age of the universe; 
only black holes with instantaneous growth time smaller than the age of the universe at any 
particular redshift can be said to be effectively growing. Right: the fraction of the final black 
hole mass accumulated as a function of redshift and final (i.e. at z = 0) mass is plotted as 
contours. 



The specific instantaneous ratio of black hole mass to accretion rate as a function of SMBH 
mass defines a timescale, the so-called growth time, or mass doubling time. The redshift evolution 
of the growth time distribution can be used to identify the epochs when black holes of different 
sizes grew the largest fraction of their mass: black holes with growth times longer than the age of 
the universe are not experiencing a major growth phase, which must have necessarily happened 
at earlier times. 

Figure [22] (left) shows that, according to this simple estimate, while at z < 1 only black holes 
with masses smaller than 10 M are experiencing significant growth, as we approach the peak 
of the black hole accretion rate density (z ~ 1.5 — 2), we witness the rapid growth of the entire 
SMBH population. 

Solutions of the continuity equation also allow one to trace the growth of black holes of a 
given final (i.e., at z = 0) mass. The right hand side panel of Fig. [22] shows that, for the most 
massive black holes (> 1O 9 M ), half of the mass was already in place at z ~ 2, while those with 
M(z = 0) < 1O 8 M had to wait until z ~ 1 to accumulate the same fraction of their final mass. 

3.2 The AGN-galaxy connection 

The very existence of scaling relations between black holes and their host galaxies, and the broad 
accretion rate distributions of AGN derived from the continuity equation approach imply that, 
as observed throughout the electromagnetic spectrum, growing black holes will display a large 
range of "contrast" with the host galaxy light. 
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The most luminous QSO, accreting at the highest Eddington ratios, will be able to outshine 
the stellar light from the galaxy, while less luminous, Seyfert-like AGN will have a global SED 
with a non- negligible contribution from the host (see also eq. above) . At high redshift, when it 
becomes increasingly difficult to spatially separate the nuclear emission, unbiased AGN samples 
will have optical-NIR colors spanning a large range of intermediate possibilities. 

Figure [23] nicely illustrates this point. It is taken from the analysis of an X-ray selected 
sample of AGN in the COSMOS field ferusa et all 120101 ) . the largest fully identified and redshift 



complete AGN sample to date. It displays the slope of the rest-frame SED in the optical (ckopTj 
between 0.3 and 1 /mi) and NIR («nir between 1 and 3 /jm). Pure QSOs, i.e., objects in which 
the overall SED is dominated by the nuclear (AGN) emission have a typical dip in the NIR 
region, and would lie close to the empty blue star in the lower right corner (positive optical 
slope and negative NIR slope). The location of the X-ray selected AGN in Figure [23] shows 
instead that, in order to describe the bulk of the population, one needs to consider both the 
effects of obscuration (moving each pure QSO in the direction of the orange arrow) and an 
increasing contribution from galactic stellar light (moving the objects towards the black stars in 
the upper part of the diagram) . 

This demonstrates that current multi-wavelength extragalactic surveys are sensitive enough 
to disentangle the complex interplay between nuclear and galaxy light in the SED of more typical 
AGN. It is no coincidence that such surveys are beginning to probe the details of the co-evolution 
of black holes and host galaxies on an object-by-object basis. In the following section we will 
briefly discuss how one can use such information to observationally trace the evolution of the 
scaling relations between nuclear SMBH and their host galaxies. 

3.2.1 Redshift evolution of the scaling relations 

Local scaling relations between black hole mass and structural properties of their (spheroidal) 
hosts have been unable to unambiguously determine the physical nature of the SMBH-galaxy 
coupling. A large number of theoretical models for the AGN-galaxy interaction responsible for 
establishing, for example, the M — a* relation, have been proposed, all tuned to reproduce the 
z = observations. One obvious way out of this impasse is the study of their evolution. 

In recent years, a number of groups have employed different techniques to detect signs of 
evolution in any of the locally observed scaling relations. Only type 1 AGN, with un-obscured 
broad line region allow a simple direct estimate o f BH masses, via the so-called "virial" or 
empirically calibrated "photo-ionization" method ( Peterson et al. . 20041 ) . Based on existing 



samples of broad line QSOs, most efforts ha ve been devoted to the study of the Mbh — <?* 



relation. For example, Salviander et al. (j2007l ) have used narrow nebular emission lines ([OIII], 
[Oil]) excited by the AGN emission in the nuclear region of galaxies as proxies for the central 
velocity dispersion, and compared these to the black hole mass estimated from the broad line 
width of QSOs from z ~ to z ~ 1. In this case, a large scatter has been found in the relation 
between Mbh and a*. 

An alternative path is to study carefully selected samples of moderately bright AGN in 
narrow redshift ranges, where the host's stellar velocity dispersion can be measured directly from 
the absorption lines in high signal-to-noise spectra. These studies also found evidence of (strong) 



positive evolution of the Mbh to <7* ratio compared to the local value (see lBennert et al.l 12011 



and references therein). This method, although promising and reliable, is quite inefficient and 
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Figure 23: Observed rest-frame SED slopes in the optical (aoPT, between 0.3 and 1 /im) and 
NIR («nir between 1 and 3 //m) for all ( 1650) X-ray selected AGN in the COSMOS survey. Blue 
filled circles denote spectroscopically confirmed type 1 (Broad Lined) AGN, blue empty circles 
denote candidate type 1 AGN from the photo-z sample. Red filled circles are spectroscopically 
confirmed type 2 (Narrow lined) AGN, empty red circles are candidate type 2 AGN from the 
photo -z sample. The empt y blue star marks the colors of a pure intrinsic type 1 quasar SED 
(from Richards et al.l 20061 ). while black stars are the loci of synthetic spectral templates of 



galaxies, with increasing levels of star formation form the left to the right. Nuclear obscuration, 
parametrized with a Calzetti extinction law, moves every pure type 1 AGN along the direction 
of the orange arrow. 



40 



z-1.3 (This Paper)* 
z-0.05 (Bennert+ll)« 

-0.08,0.4,0.6,1.8 (see Bennert+10>3 



5 10 
lookback time (Gyr) 



z-1.3 (This Paper)* 
z~1.5 (Merloni+10)» 
!~0.05 (Bennert+ll)« 

.8 (see Bennertt 10)-j 



5 10 
lookback time (Gyr) 



Figure 24: Left: Offset in logMeH as a function of constant spheroid host galaxy mass (red 
filled pentagons) with respect to the fiducial local relation of AGNs (black filled circles). The 
offset as a function of constant stellar spheroid luminosity is over-plotted (green open symbols), 
corresponding to AGNs at different redshifts. The best linear fit derived here is over-plotted 
as dotted line Mbk/M^ oc (1 + ^) 2 - 1:1=0 - 3 ; dashed lines: la range. Right: The same as in the 
left panel as an offset in logA/BH as a function o f constant tota l host galaxy mass. The lines 
correspond to MBH/-^host oc (1 + z) 1 ' 411 * 10 ' 12 . From lBennert et al.l ( 201ll ). where a comprehensive 
list of references for the observational data points can also be found. 



telescope-time consuming: secure detection of spectral absorption features in massive ellipticals 
at 1 < z < 2 require hundreds of hours of integration time on an 8-meter class telescope. 

When a good sampling of the AGN SED is instead available, rather than high-resolution, high 
signal-to-noise spectra, it is possible to try to decompose the overall spectral energy distribution 
into a nuclear and a galaxy component, and derive in this way the physical properties of the 
host galaxies o f un-ob scured AGN whose SMBH masses can be estimated from their broad lines 



(jMerloni et all l20inl ). 



Other groups have chosen to try to derive information on the host mass of broad line AGN 
using multi-color image decomposition techniques. Due to the severe surface brightness dimming 
effects, employing these techniques for high-redshift QSOs becomes increasingly challenging, 
unless gravitationally lensed QSOs are selected. In all cases, very deep, high resolution optical 
images (HST) are necessary to reliably disentangle the nuclear from the host galaxy emission. 

The main result of these various investigations is that our estimates of the type-1 AGN 
host physical parameters are inconsistent with the hypothesis that they lie on the z = scaling 
relation (see Figure [24")) . At high redshift, bigger black holes are hosted in galaxies of a given 
mass as compared to what we observe locally. The best linear fit to the ensemble of observations 
shown in Figure [Ml is Aff3ri/-^sph oc (1 + £) 2 - 1±0 - 3 for the black-hole-to-spheroid mass ratio and 
M Bll /M host oc (1 + z) 1A1±0 - 12 for the black-hole-to-total host stellar mass ratio. 

However, the objects for which this study can be made are selected essentially on the basis of 
the nuclear (AGN) luminosity, and on the detectability of broad emission lines, clearly leading 
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to a bias towards more massive black holes, similar to Malmquist bias for luminosity selected 
samples of standard candles. Can such a bias be responsible for the observed trends? 

Let us consider in detail the effects on the observed systems of a given intrinsic scatter, cr„, 
in the -Mbh ~ Af* scaling relation. Any non-zero implies that there is a range of possible 
masses logM* ± for each object of a given black hole mass Mbh> where we have assumed, 
for simplicity, a symmetric scatter in the relation. If the number density of galaxies is falling off 
rapidly in the interval logM* ± <r^, it will then be more likely to find one of the more numerous 
small mass galaxies associated with the given black hole, and therefore a larger ratio Mbh/M*. 
Thus, given a distribution of galaxy masses, and provided that the scatter is not too large, 
the logarithmic offset of each point from the correlation, assumed to be held fixed to the local 
determination, is given by: 

A log(M BH /M*) = 0.67 x A log M BH ~ °l ( jf* ° g f. ) , (14) 

V « 1o S M * J logM,=(p-A)/B 

where // = log Mbh an d (A,B) = (1.12,-4. 12) are slope and i ntercept of the local scaling 



relation between BH and host galaxy masses (jHaring &: Rixl . |2004| ) . 



One can estimate observationally the logarithmic derivative of the galaxy mass function 
diogM • At z w 2, the offset expected from such a bias is of the order of 0.25 dex, if = 0.5 
and increases to about 0.5 dex for = 0.7. The average offset shown in Fig. [24] is clearly in 
excess of what is expected in the m ost extreme cas e of lar ge intrinsic scatter in the local relation, 
estimated to be less than 0.5 dex ( Giiltekin et al. . 20091 ). The data point towards an evolution 



of the scaling relation, either in normalization or in scatter (or a combination of both). 

What are the implications of these findings for our understanding of the cosmological co- 
evolution of black holes and galaxies? 

In the next section, we will discuss in more detail a number of physical processes by which 
AGN can regulate the growth of their host galaxies, thereby affecting any observable evolution 
of the scaling relations. We will see how, from the physical point of view, a clear distinction has 
to be made between two modes of AGN feedback. 

The first one is associated to the numerous, long-lived, LLAGN, with emitted power dom- 
inated by the kinetic energy of their jets and outflows. It becomes increasingly important for 
very massive holes at low redshift (see section [3.1.11 above). Many models of galaxy formation 
invoke such a feedback mechanism in orde r not to over-produ ce very massive galaxies in the 



largest virialized DM halos at low redshift (jCroton et al 



ir- produ c( 



It is not clear, however, how such a feedback mode can effectively couple the SMBH mass with 
the structural properties of their galactic hosts and give rise to the observed scaling relations. 
For such a task, modelers have instead turned to feedback modes associated to the phases of 
fast SMBH growth in bright QSO. 

In all feedback models in which the black hole energy injection is very fast (explosive), if 
strong QSO feedback is respo nsible for rapidly terminating star formation throughout the entire 



bulge ([Di Matteo et al.l . 120051 ). QSOs and, in general, type-1 AGN are associated with the final 
stage of bulge formation. Then, very little evolution, as well as very little scatter, is expected 
for the scaling relations, and it is very hard to produce any positive offset like the one observed. 

The physics of such ("quasar") mode of AGN feedback remain elusive, as it remains the issue 
of whether the energy release by the associated process of rapid black hole growth is indeed 
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responsible for halting the conversion of gas into stars on galactic (kpc) scales, or whether it 
is only responsible for a milder form of "self-regulation" by cutting off its own gas supply on 
nuclear (pc) scales ( Hopkins et al. . 20091 ). 



4 Cosmology II: AGN feedback 

The phenomenological investigation presented in § [3] above leaves open the fundamental question 
about the physical origin of such a clear, parallel differential growth of both the black holes and 
the galaxy population. 

From the discussion of AGN activity in Chapter "Active Galactic Nuclei" by E. Perlman 
in this same volume, it should be immediately apparent that black hole growth is often, if not 
always, accompanied by the release of enormous amounts of energy, in the form of radiation, 
outflows, and gravitational waves. 

Black holes accreting at high rates in the so-called radiative (or quasar) mode will release 
of order 10% of the accreted rest mass energy as radiation. They can also drive broad (un- 
collimated) outflows, again described in more detail in chapter "Active Galactic Nuclei" by E. 
Perlman in this book, and in about 10% of bright AGN, radio emitting, relativistic jets are 
observed (the quasar 3C273 seems to be such an object that is accreting efficiently and making 
powerful jets at the same time). 

But even black holes in the so-called inefficient accretion regime, where cooling is dominated 
by advective processes rather than radiation, can drive powerful, collimated outflows in the form 
of relativistic jets. Perhaps the best example of such a powerful "low efficiency" black hole is 
the radio galaxy Virgo A, which is the product of inefficient accretion onto the supermassive 
black hole at the center of M87, which itself is located in the center of the Virgo cluster. See 
§ "Active Galactic Nuclei" by E. Perlman in this book for a detailed discussion of the properties 
of the M87 jet. 

This energy will be released directly into the environment from which the black hole grows: 
the cooling, possibly star-forming gas in the central galaxy. Any transfer of energy to the gas 
should thus reduce the rate at which gas cools and forms stars. While the direct link between 
star formation through cooling in the centers of galaxies and black hole growth through accretion 
is not fully established, it is easy to imagine how such an energy deposition can reduce the rate 
of accretion onto the central black hole as well. 

This process of cooling-induced black hole activity can therefore be considered as a negative 
feedback loop, in that increased accretion activity acts to decrease the large scale gas supply 
to the black hole. The impact on star formation might be coincidental (if black hole growth is 
unrelated to the actual star formation rate) or fundamental (if black hole growth is mediated or 
directly fueled by star formation, for example, through direct accretion of stars). 

Furthermore, while the direct link between black hole growth and star formation suggested 
by the M-cr* relation is hidden, and evidence for the suggested underlying feedback process on 
stars is largely circumstantial (as will be discussed below), some important clues can be derived 
by tracing the evolution of the feedback energy released by growing black holes as a function of 
black hole mass and redshift. 

In this section, we describe in some detail how such an inventory can be made and how 
feedback itself operates. We will focus primarily on the information about the properties of 
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black holes that can be extracted from observations of feedback, with other chapters discussing 
the role of black hole growth on the formation of structure in more detail (see § "Clusters of 
Galaxies" by R. Bower in this book). 

4.1 Evidence and arguments for feedback 

The process of accretion is a multi-scale phenomenon: The range from the place of capture, 
where the gas first enters the sphere of influence of the black hole, to the event horizon of the 
black hole spans roughly seven orders of magnitude in scale — too much to simulate in one big 
simulation for even just one dynamical time on the outer scale. 

Yet, as extreme as this range in scales may be, the process of feedback can cover another 5 
orders of magnitude more in scale: Prom the scales of the horizon (about AU-size for a typical 
central black hole in a typical, L*, galaxy) to scales of entire galaxy clusters (several hundred 
kiloparsec): a dynamic range of twelve orders of magnitude. 

Given that our understanding of accretion is still developing, and that our understanding 
of jet formation is, at best, elementary, it should not come as much of a surprise that our 
understanding of AGN feedback is mostly limited to fairly crude statements about energy input 
and global heating efficiencies from a theoretical perspective. 

The best observational evidence for feedback is not on galaxy scales at all, but on the largest 
spatial scales on which we can expect black holes to have any meaningful influence: In the 
centers of galaxy clusters. The reason for this is twofold: 

• First, the angular scales on which feedback in galaxy clusters unfolds are readily resolvable 
by telescopes in all bands of the electromagnetic spectrum. 

• Second, the signatures of AGN feedback in galaxy clusters are easy to identify from X-ray 
and radio imaging, as we will discuss momentarily. 

Consequently, we have developed a fairly mature picture of how AGN feedback works on the 
very largest scales and have even successfully simulated the feedback processes in computers. 

On smaller scales, the evidence for feedback becomes increasingly circumstantial. Thus, while 
the link between black hole and galaxy properties may be the most fundamental expression of 
direct coupling of their growth processes, it is also the most elusive in terms of direct evidence 
for this coupling. 

A number of reasons conspire to limit our observational insight into galactic scale feedback: 

• The angular scales of this process are inherently small, given that the feedback must be 
happening in the centers of galaxies. 

• While cluster evolution is happening in the current epoch, at low redshift, galaxy growth 
happens at higher redshift - during the star formation epoch. This is especially true for 
the galaxies that seem to require AGN feedback the most. 

• Both star formation and rapid black hole growth tend to cloak themselves in dust extinction 
and photo-electric absorption. It may be that the smoking guns of feedback are mostly 
hidden behind Compton-thick X-ray absorbers and many magnitudes of dust extinction. 
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Finally, the tight connection between black hole growth and star formation suggested by the 
M — a* relation and by the similarity in the redshift evolution of both populations seems to imply 
that stars and black holes grow roughly simultaneously. For feedback to have a strong impact 
on star formation and at the same time couple the mass of growing black holes to the mass of 
stars in a galaxy, one would expect rapid black hole growth to be concurrent with episodes of 
star formation. 

This would imply that feedback on star formation would have occurred during the quasar 
phases, and since most quasars are radio quiet, this suggests that at least part of the feedback on 
star formation operates through a different channel than the readily observable "radio galaxy" 
feedback on cluster scales at low redshift. Given that this feedback must have occurred during 
the quasar epoch, it is commonly referred to as "quasar mode" feedback. 

In fact, the most convincing "evidence" for such a mode comes not from actual observations 
of black holes but from semi-analytic models of galaxy formation: In order to explain the galaxy 
luminosity function and galaxy color distribution, modelers have to assume two types of feedback: 
One that disperses and heats the star-forming gas at the end of a star-formation cycle (generally 
triggered by mergers), effectively halting star formation — this is the "quasar mode" — and 
one that maintains the gas in ty pical elliptical galaxies in its tenuous, ho t state — this is the 
"radio" or "maintenance mode" flSpringel et ID . 1200.4 ICroton et all l200fih . 



However, these models say nothing about the actual physical mechanism of feedback: they 
assume quasi-spherical heating of the gas in both "quasar" and "radio" mode, and the only thing 
that distinguishes them is the prescription of how the black hole accretes (whether from cold or 
hot gas). The more appropriate naming convention is thus "cold" and "hot" mode accretion. 

Thus, the circumstantial evidence for "cold" mode feedback does not answer the question 
of whether the heating/dispersal occurs as a result of winds, jets, or radiation released by 
the accreting black hole. Given th at slowly g rowing black holes are radiatively inefficient and 
universally seem to be radio-active (He], 20081 ). it has generally been assumed that any feedback 



from black holes in the "hot" mode must be in the form of jets. 
4.2 Feedback in galaxy clusters 

It is instructive to begin by discussing the obvious examples of AGN feedback. This will inform 
our discussion of the possible influence of AGN on the process of star formation on galactic 
scales. In particular, from a discussion of radio galaxy feedback on cluster scales it is possi- 
ble to draw quantitative conclusions about "radio-mode" or "hot-mode" feedback by jets from 
slowly growing black holes. For a more detailed discussion of feedback in galaxy clusters, see 
McNamara fc Nulsenl (|2007l ). 



On a basic level, the importance of feedback was already apparent with the discovery of 
powerful radio galaxies in the 1960s and onward (though the relevance of the black hole in 
this context took longer to establish): Radio galaxies, like the example of Cygnus A shown in 
Fig. [25j exhibit diffuse "lobes" of synchrotron emission (see chapter "Active Galactic Nuclei" by 
E. Perlman in this same volume), on scales of tens and even hundreds of Kiloparsec. In other 
words: The action of a jet from the central black hole deposits magnetized relativistic plasma 
into the surrounding medium. 

Simply summing up the entire synchrotron radiation and making reasonable assumptions 
about the shape and volume filling fraction of the emitting regions, it is straight forward to 
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Figure 25: Left: The FRII radio galaxy Cygnus A, observed by the VLA at 6cm; image scale: 
150 kpc x 85kpc; right: The large scale structure of the FR I radio galaxy Virgo A, observed 
by the VLA at 90cm. The relativistic inner jet of M87 is contained in the over-exposed central 
radio lobes; image scale: 80 kpc x 80 kpc. 



derive lower limits on the total energy neede d to explain the rad io emission. In some cases, the 
minimum energy derived could be enormous: IPerlev et all (jl984l ) found that Cygnus A required 
at least E m i n ;> 10 60 ergs pumped into the lobes by the central black hole. For perspective: This 
is of the same order as the gravitational binding energy of the Milky way. 

If jets could release this much energy in relativistic gas into the environments of black holes, 
it would be hard to imagine how the environment could not be strongly affected. 

The first direct evidence for feedback on the gas surrou nding the black hole cam e with the 
arrival of high-resolution X-ray imaging: using R OSA T data. iBoehringer et al.l (|1993l ) discovered 
that the radio galaxy Perseus A (powered by the supermassive black hole in the central cluster 
galaxy NGC 1275) excavates large cavities in the hot, X-ray emitting thermal gas that fills the 
Perseus cluster. The gas is pushed aside into dense shells and the excavated X-ray cavities are 
filled with radio emission by the lobes of the radio galaxy (see Fig. [26]) 

Similarly, the privileged view we enjoy of the nearby radio galaxy Virgo A (also known 
as M87) allowed a uniquely detailed study of its multi-scale emission well before the idea of 
feedback had taken hold. The inner (roughly kpc) jet of M87 is discussed in some detail in 
chapter "Active Galactic Nuclei" by E. Perlman in the same volume. However, lower frequency 



observations revealed a much richer picture on scales j ust outside of the visible galaxy, still in 
the very center of the Virgo cluster (jOwen et all |2000| ) : Curling and twisting strands of radio 



emission, connecting the nucleus to a set of radio lobes about 20 kpc in radius, and misaligned 
with respect to the central jets by about 90 degrees on the skjU. 

Both Perseus and Virgo are cool core clusters, and in particular Perseus had long been 
considered a prototypical example of a cooling flow. That is, the radiative cooling time in the 
center of the cluster is shorter than the age of the cluster. In a quasi-hydrostatic model of 
a cluster (inward gravity, mostly provided by the dark matter contribution, balanced by an 



Part of this misalignment could be due to projection, of course, given that at least the inner jet is directed 
fairly close to the line-of-sight. 
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outward thermal pressure gradient), this would imply that the cluster must be contracting on a 
Kelvin-Helmholtz timescale, with gas at the center cooling rapidly to star-forming temperatures. 
Cooling gas f rom fur t her o ut in the cluster would replace the gas in a slow, sub-sonic inflow (for 



a review, see 



Fabianl . 11994 . and references therein) . 
Even before the era of Chandra and XMM it was already apparent that this simple picture 
of ongoing inflow of cooling gas did not accurately describe cool core clusters: The implied rates 
for star formation were an order of magnitude higher than the observed rates. 

Radio surveys of cluster centers revealed that essentiall y all traditional "cooling flow" clusters 
had active radio galaxies in their centers ( Burnsl . 1990l ). Generally, these radio sources are 



Fanaroff-Riley type I sources (henceforth abbreviated as FR I; see chapter "Active galactic 
nuclei" by E. Perlman in this book for a discussion of radio source morphology), though it is not 
entirely clear whether this is due to lower average source power compared to field FR II galaxies 
or due to the increased gas density in clusters (frustrating source evolution and possibly leading 
to increased entrainment). 

Guided by the detailed examples of feedback in the Virgo and Perseus clusters and the 
observed mismatch between the X-ray cooling rate and the star formation rates in clusters, 
the first models of bla ck hole feedback in the context of galaxy clusters were presented in 
Tabor fc Birm^vl (jl993h . 



4.2.1 The Chandra and XMM-Newton view 

The role of AGN in regulating the cooling of gas in cool core clusters was brought into clear 
focus with the launches of Chandra and XMM-Newton in two ways: 

Chandra observations revealed the presence of cavities just like those found in the center of 
Perseus in virtually every cool core cluster, providing the observational confirmation that the 
radio galaxies present in these clusters actively perturb the gas. Generically, the cavities appear 
to be surrounded by relatively cool gaa3- Deep Chandra observations sometimes reveal multiple 
cavities on different scales, which has been interpreted as evidence for variability in the AGN 
powerd. 

At the same time, XMM-Newton's high-resolution X-ray spectra of the cluster centers re- 
vealed that radiative cooling must be impeded below a threshold temperature of order 10 mil- 
lion degrees (about 1 keV), at a temperature where cooling should be efficient and rapid due 
to the flattening of th e cooling curve for thermal gas as atomic line cooling becomes dominant 
(jPeterson et all , 120031 ). 



This result is consistent with the observed lack of star formation in central cluster galaxies, 
compared to the hundreds of solar masses of star formation per year that would have been 
expected based on simple cooling flow models. It moves the discrepancy of cool gas missing at 
molecular temperatures to cool gas missing at X-ray temperatures below about a keV. In either 
case, a heating agent is needed, but in the "revised" cooling flow problem, the gas that must be 
preferentially targeted is at about a keV and will thus occupy a much larger volume fraction, 
which should make it easier to interact with for any feedback mechanism. 



7 This w as surprising be c ause one might naively expect the gas most strongly affected by feedback to be hot. 
But see iMorsonv etafl (|2010h for arguments why the presence of cavities is not a sufficient argument for AGN 
duty cycles. 
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Figure 26: Left: Deep Chandra observation of the Perseus cluster ( Fabian et al. . 20061 ) ; mid - 
dle: Chandra image of MS0735 (red) and VLA (blue), adopted from iMcNanwa, et alf B: 



right: Chandra image of Hydra A (blue) and 6cm VLA radio image (red), adopted from NASA 
(jKirkpatrick et all hood ) : image scale: 80 kpc x 80 kpc. 



Thus, after about a decade of study, a standard paradigm has emerged from the high inci- 
dence of radio loud AGN in cool core clusters and from the theoretical requirement of a heating 
agent that maintains the temperature distributions in galaxy clusters: Radio galaxies provide 

the energy needed to counterbalance cooling in the centers of clusters. 

From these observations, and from theoretical modeling ( Begelman Sz Cioffi . 19891 : Reynolds et al 



2001 



a simple understanding of radio source evolution has been developed that underpins the 
radio galaxy feed back paradigm. Accor ding to this picture, radio source evolution separates into 
three stages (e.g. iReynolds et all l200ll ): 



1. In the initial supersonic phase, jet plasma inflates cocoons that are strongly over-pressured 
relative to the environment. These cocoons must expand, and the rapid energy release 
implies that this expansion is supersonic in the frame of the environment. 

The expansion is similar to that of a wind-blown bubble described by Castor et al. ( 19751 ): 
The cavity radius roughly follows the self-similar scaling^ 



R oc 



PlCM 



1/5 



(15) 



which is functionally equivalent to the Sedov- Taylor solution if the blast energy is replaced 
by the injected energy over time, Pj e tt- In this expression, piqm is the density of the 
environment. 



Note that this argument neglects the actual jet propagation completely and assumes the 
jet energy is randomized as the jet encounters the environment (in more powerful FR II 
sources) or through entrainme nt (which has been suggested as the dissipation agent in FR 
I source; lLaing fc Bridk]l2002l ). 



9 This expression applies to bubbles smaller than a cluster pressure scale height. It is straight forward to extend 
it to stratified powerlaw atmospheres. 
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2. As the source expands, the pressure inside the cocoon and in the shell eventually ap- 
proaches the pressure of the environment and the expansion becomes sub-sonic. The 
initially generated shock wave of the supersonic expansion will continue to coast outward, 
leaving behind a sub-sonically expanding cavity. As the expansion velocity becomes sub- 
sonic, the confinement is dominated by the thermal pressure of the environment, so the 
solution changes to a pressure confined bubble, 



3. Finally, as the source expansion velocity drops below the buoyancy speed or once the 
pressure of the source drops below the dynamic pressure of motions in the environment, 
the cavities / cocoon will detach and float away from the black hole buoyantly or advectively. 

Once cold gas has refilled the central region of the cluster, any jet activity will start the 
cycle anew. 

It is clear from eq. (115p that jet power and density are the controlling variables in the initial 
evolution: Lower power jets in denser environments will be more easily frustrated (with more 
slowly expanding cocoons that become sub-sonic and unstable at smaller sizes). 

4.2.2 Estimating the kinetic power of a radio source 

Before the discovery of X-ray cavities, measurements of the kinetic power of radio galaxies (that 
is, the total power traveling down the jets) were limited to estimates based on the observed 
synchrotron emission (see discussion in §4.2p . These were hampered by several factors: 

• Without knowledge of the field strength, an observed synchrotron flux, along with an 
estimate of the emitting volume could only provide a lower limit of the total energy in 
the radio plasma (essentially assuming equipartition between the energy in electrons and 
magnetic field). 

• The estimate of the volume depends strongly on the volume filling fraction, which is not 
measurable. 

• Synchrotron aging can cause electrons to cool and develop a sharp cutoff in the syn- 
chrotron spectrum. Thus, significant amounts of energy in lower-energy electrons would 
be unaccounted for in the total power budget. 

One of the most important results from the discovery of X-ray cavities in clusters is a robust, 
independent way to estimate the power of cluster radio sources. It is based on the fluid mechanics 
of inflated bubbles: In order to inflate a cavity in the intra-cluster gas, the jet must (a) displace 
the material in the environment into a shell surrounding the cavity, which is of the order of 
E p v ~ pV (and depends on the details of the inflation history of the bubble) and (b) replace it 
with relativistic, magnetized gas. At a minimum, the amount of energy needed to do this is the 
work done on the cluster gas and the internal energy of the radio plasma. If the expansion of 
the cavity is adiabatic, the total energy needed is 




(16) 



E, 



^ypV 



(17) 



'cavity — 
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where 7 is the adiabatic index of the gas inside the cavity and is typically assumed to be 7 = 4/3, 
given the presence of relativistic electrons and tangled magnetic fields. 

Estimating the age of the cavity, and thus the jet power needed to innate it, is more difficult 
and introduces some uncertainty. Direct kinematic measurements of the expansion velocities of 
cavities are impossible with current X-ray telescopes. However, in many cases, the observations 
suggest that the temperature of the shells surrounding the cavities is low. In this case, it is safe 
to assume that the recent expansion of the cavity was sub-sonic. Thus, the sound crossing time 
of the bubble radius is a reasonable lower limit on the cavity age: 

, . _ -Rcavity ,-, s s 

"-cavity 'sonic — V 10 / 
Cs 

where -Rcavity is the radius of the cavity and c s the sound speed of the cluster gas. 

Given that most cavities are found in cluster centers, a reasonable upper limit on the age 
of the cavity is the buoyant rise time Tb uoy of the bubble in the gravitational potential of the 
cluster (since an bubble older than Tb uoy would have risen out of the cluster center): 

, . 2it! cavi t y 2R cavit y _ / 3Cw din (R) , 

Z-cavity S ''"buoy ~ ~ / n — 777; — ^sonicl/ . ;i / m ~ ^sonic 



where CVv is the drag coefficient of the rising cavity and typically assumed to be of order 
C\v ~ 0.5 and the exact numerical value of the expression under the square root depends on 
the pressure scale height of the cluster in bubble radii, but should be of order unity for typical 
observed bubble radii 10 !. For detached cavities, the appropriate age to use is the buoyancy time 
for the projected distance instead of the bubble diameter. 

Given that buoyancy sets in after the source becomes sub-sonic, this loosely brackets the 
power inferred for the jets from the measurement of cluster cavities to 

-E'cavity -^cavity -^cavity 

£ -Pjet £ (20) 



''"buoy ''"sonic 3t si 

Estimates of the central cluster density and temperature (and thus pressure and sound speed) 
are readily obtained from X-ray images and spectra. The most difficult part is the estimate of 
the cavity volume, since errors in the estimated cavity radius and viewing angle uncertainties 
can compound to errors of up to an order of magnitude in source power. Nonetheless, this 
method has afforded us with a large number of reliable estimates of jet powers to within a factor 
of a few for dozens of radio galaxies in nearby clusters^. 

While early, shallower Chandra exposures of cluster centers only showed cool shells in the 
vicinity of the cavities, deep observations of a number of im portant clusters later also showed the 



presence of shocks surroun ding at least some of the cavities (jMcNamara et all 120051 : IWise et al 



20071 : iForman et al.l . 120071 . e.g.). Given the generic picture of how radio sources evolve over time 



described in ^4.2.11 t he presence of weak shocks should be expected (and had been predicted in 



Reynolds et al.ll200lh . 



10 The buoyancy speed can never exceed the sound speed. 

n It should be kept in mind that the inferred powers are averages over the cavity age, which can be between 
millions to hundreds of millions of years old. 
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In fact, an important corollary from eq. (|15p is that the initial strongly supersonic phase is 
short lived in typical cluster environments: The expansion velocity of the shell is 



^shell = ^ OC (^jj) OC iT 2 / 3 OC (21) 

Given that cavities should remain in the cluster centers for about 2-3 sound crossing times 
before becoming buoyant, the fraction />m of time a given radio galaxy spends expanding 
super-sonically at or above a given Mach number M, relative to the total dynamic lifetime 
before buoyant removal, should only be of order 

f>M ~ ^ ~ \m~" 2 (22) 

Thus, the observational lack of evidence for sources expanding at large Mach numbers does not 
rule out that radio sources go through this strong shock phase. It is, however, short lived and 
only a small mass fraction of AGN's environment passes through a strong shock. 

The detection of a shock (which requires not just the detection of a surface brightness jump, 
but also a temperature jump, which is most easily identified through a harder X-ray color) offers 
a significantly better diagnostic of jet power than the cavity method. Because the shock strength 
is an indication of the expansion velocity, a measured shock radius, brightness, and strength can 
be modeled using simple ID spherical shock models to give a reliable source power. Typical 
Mach numbers for shocks detected in clusters are between one and two, consistent with this 
argument. 

This rather simple parametric description of radio source evolution is complemented by a 
growing body of numerical simulations of jet-driven feedback . Initial 2-dimensional simulations 
generally supported the simple picture ( Reynolds et al.l . l200ll ). However, a thorough understand- 



ing requires full 3-dimensional simulations, and work on understanding the details of feedback 
ab initio is still in the early stages. 

A key problem posed by 2D and early 3D simulations is the apparent c ontradiction of highly 



bipol ar release of energy in the jet and the need for mostly isotropic heating (IVernaleo &: Reynolds 



2006) 



While outgoing shocks assume a spheroidal shape relatively quickly, heating by shocks 
is insufficient to solve the cooling flow problem (see eq. 122ft . In addition, jets evacuate cocoons 
around them. Ongoing, unidirectional jet activity was found to propagate inside this cocoon, 
dynamically and energetically isolated from the inner cluster gas and thus unable to counteract 
cooling in the center. 

The solution might lie in the interaction with the cluster and in the internal dynamics 
of jets: iHeinz et al.1 l|200d ) found that the jets can continue to efficiently couple to the inner 



cluster if their axes are subjected to a moderate wobble and, crucially, the cluster itself is 
dynamically evolved in the context of a cosmological simulation. Simulations generally show 
that the complex X-ray appearance of clusters, and even the appearance of multiple successive 
cavities, can be generated by a s ingle, ongoing episode of jet activity and a dynamic cluster 
atmosphere ( Morsonv et al. . 2010l ). This suggests that the interaction between jets and clusters 



goes both ways: cluster dynamics affects jet dynamics and vice versa. 
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Figure 27: Left: jet power inferred from cluster cavitie s plotted agains t X-ra y cooling luminosity 
from within the cluster cooling radius, adopted from iRaffertv et al. l|2006l ): the diagonal lines 
indicate the efficiency required for the jet pow er to offset cooling, with the line labeled as 
ApV equivalent to 100% efficiency, adopted from kaffertv et all «; right: jet power plotted 



against Bondi accretion rate, adopted from I Allen et al] (|2006l ). 



4.2.3 Cluster radio sources as a population 

A census of nearby clusters with cavities reveals a number of important insights about the 
statistical and global properties of central cluster radio sources: 

• When plotting jet power vs. X-ray luminosity, radio sources straddle the heating=cooling 
line: About half of the radio sources sampled have kinetic powers that are highe r than the 
cooling luminosity of the cluster (see Fig. [27] adapted from Raffertv et al. 20061 ). 



More importantly, the jet power appears to be correlated with the cooling luminosity of 
the cluster: More powerful radio sources are found in clusters with highe r cooling rates . 



This is exactly the signature one would expect in an AGN feedback picture (jRafferty et al 
20061 b 



The jet power measured from cavities appears to be related to the Bondi accretion rate 
of the cluster. That is, in cluste rs with higher cen tral densities and/or lower core temper- 
atures, the jet power is higher ([Allen et all l2006h . While this correlation does not imply 



that black holes actually accrete at the Bondi rate in clusters, the relatively close match 
suggests that black holes accrete directly from the cluster gas as it flows into the central 
galaxy (see Fig. [2] 



Together, these results suggest that the balance between heating and cooling in clusters is 
relatively tight. In fact, the high efficiencies suggested by these findings, in a global sense, as 
well as from studies of individual, powerful black holes with relatively low masses, have led to 
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the suggestion that the black holes powering the jets in cluster centers might even require the 
extraction of black hole spin ([McNamara et al.l . 120111 ) . 

However, given the significant uncertainties in the jet power estimates, and given that clusters 
are, in all likelihood, not steady state systems (thus, cooling rates can temporarily exceed heating 
rates, as long as they are balanced on average), a sufficient region of parameter space is still 
allowed in which AGN can balance cooling without requiring extreme efficiencies, accretion rates, 
or black hole masses. 

All of the detailed studies of radio galaxy feedback in clusters have been limited to clusters 
at relatively low redshifts, because of the need for high-fidelity X-ray images of cavities and 
shocks. In addition, high-redshift cluster samples are sparse. Consequently, constraints on 
cluster feedback at higher redshift are much harder to obtain. Radio s urveys of high-redshif t 



2006) 



clusters do indicate an increase in the cluster radio luminosity function (jBranchesi et al 
hinting at an increase in feedback activity. 

Finally, it is worth mentioning that, while the central massive elliptical galaxies harbor by far 
the most massive black holes in clusters, other cluster galaxies can be radio loud. This situation 
typically leads to the formation of a bent radio source. The exploration of the statistics of 
non-central cluster radio sources is ongoing, an d it has been sug gested that this population 
of sources could contribute to cluster feedback (jHart et al.1 . 120091 ). However, it is difficult to 



envision a scenario whereby a population of such sources will dominate the heating rate in the 
average cluster. It is also unclear how they could respond to central gas cooling as would be 
required for thermal regulation of the cluster gas. 



4.3 Feedback in groups 

Due to the lower temperatures and densities in the intra-group medium, detecting evidence for 
group- wide feedback from X-ray observations is significantly more difficult than in clusters. 

Statistical X-ray studies of cluster and group samples show that, generically, lower mass halos 
have excess central entropy when compared to self-similar models of halo formation, indicating 
that an additional source of non -gravitational heating must have injected entropy preferentially 



into the low mass syste ms fe.g. iPonman et all I2003T ). AGN have been suggested as a possible 



heating mechanism (e.g. Short fc Thomas . 120091 ) . Figure [28] shows how the inclusion of feedback 
in detailed models of cluster and group atmospheres affects primarily low mass systems and raises 
their central entropies. 

And, in fact, surveys of groups suggest that such a scenario might work: Dong et al. ( 20ld ) 
find that a fraction of at least 25% of the groups in their survey contain clearly detectable 
cavities, with a clear preference for cavities to be found in groups with cooler cores (as is the 
case in clusters). In their sample, the presence of cavities does not appear to be correlated with 
the 1.4 GHz radio flux. 

On the other hand, a survey of radio properties of groups shows that the central temperatures 
of groups with central radio sources are elevated compared to a radio quiet sa mple of groups , 



which was suggested as a possible indication of ongoing radio galaxy feedback (ICroston et al 
20051 ). 
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Figure 28: Left: Simulations show the increasingly important effect of AGN feedback on lower 
mass clusters and groups; plot ted is the centra l gas mass fraction as a function of virial tem- 
perature (mass); adopted from Puchwein et al. ( 2008I ) ; right: same plot as in th e left panel of 
Fig. [271 but for atmospheres of elliptical galaxies instead of clusters; adopted from lNulsen et all 
(|2007f r 



4.4 Radio mode feedback in galaxies 



The best direct evidence for black holes affecting the surrounding gas within galaxies comes 
again from combined radio and Chandra observations of nearby objects: Fig. [29] shows images 
of three nearby galaxies where jets clearly excavate cavities and affect gas on sub-galactic scales: 
M87, M84, and NGC5128 (Centaurus A). In the latter case, the entrainment of gas into the jet, 
and the formation of a strong shock driven by the expanding south-western radio lobe is directly 
visible in X-rays. 

These are clear local examples of relatively powerful, evolved radio galaxies. Numerous other 
examples have been studied individually. Yet, perhaps the most convincing argument for the 
importance and prevalence of jets in massive galaxies come fro m statistical studies. 

In a study of X-ray cavities in and around nearby ellipticals, iNulsen et al.l ([20071 ) found that 
AGN power more than matched the cooling luminosity of the gas in the hot galactic X-ray halo; 
compared to the same study in clusters (shown in the left hand panel of Fig . I27p , the galaxies 
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I: 



fall consistently above the heating=cooling line ([McNamara k, Nulsenl . 

The implication that radio-mode feedback is important in massive galaxies (those that have 
detectable X-ray halos) is complemented by statistical studies of the radio source incidence in 
galaxies of different type and mass: The left panel of Fig. [30] shows a steady increase of the 
fraction of radio loud galaxies (that i s, galaxies above a fixed radio luminosity per stellar mass) 



with stellar mass of the host galaxy ([Best et all 120051 ) . The most massive galaxies exhibit the 



highest radio fluxes per stellar mass, indicating that radio mode feedback is most active in 
today's most massive galaxies, with 10% or more of the most massive galaxies hosting radio 
loud AGN. 

Given that more massive galaxies harbor more massive black holes, one might naively expect 
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Figure 29: Left: multi- wavelength image of the central region of the Virgo cluster, showing the 
influence of the black hole on sub-galactic scales; middle: multi-wavelength image of the galaxy 
M84 in the Virgo cluster (blue: radio, red: X-ray, yellow: visible); right: multi- wavelength image 
of Centaurus A. 



this result to suggest that radio loudnes s is a fraction of black hole mass. Early studies seemed 
to suggest this (e.g. Franceschini et al. . 19981 ). However, deep radio surveys of a wider class 



of black holes show that the radio loudne ss, defined relative to the bolometric flux, actually 
increases for decreasing Eddington ratios (|Hol . 20021 ): The right panel of Fig. [30] shows that 



radio emission increases in relative brightness (compared to the bolometric luminosity) for lower 
luminosity AGN. 

This suggests that black holes become relatively more efficient at liberating energy in the 
form of jets as their luminosity (and presumably accretion rate) drops, such that all black holes 
at sufficiently low accretion rate appear to be driving some form of radio-loud outflow. 

The idea that low luminosity black holes ar e universally radio loud arose roughly in parallel 
also in the study of X-ray binary black holes ( Gallo et al. . 20031 ). where it is possible to track 



individual black holes across outburst and decline into quiescence. These observations showed 
that a jet was always present at low luminosities, with increasing relative radio flux at decreasing 
X-ray luminosities. 

While a thorough theoretical understanding is still missing, it has been shown that low- 
efficiency accretion leads to the formation of geometrically thick flows, as opposed to the geo- 
metrically thin accretion disks found in, for example, Seyfert galaxies and quasars. In such a 
geometrically thick (quasi-spherical) flow, it might be much easier to build up significant mag- 
netic flux, even just from stochastic turbulent dynamo processes in the disk, which could in turn 
drive the jet (see chapter "Active Galactic Nuclei" by E. Perlman in this book). 

Anecdotally, the case of the M87 jet makes the perfect illustration of this point: The total 
radiative output from the black hole is unimpressive 12 ! at Lms7 ~ 10 41 ergs s , about two orders 
of magnitude below the luminosity corresponding to efficient accretion at the Bondi rate of that 
particular black hole . Meanwhile, the est imated jet power from this object is about two orders 
of magnitude larger dForman et al.l . l2007h . consistent with the accretion power one would derive 



if the black hole were accreting at the Bondi accretion rate, thus making M87 a jet-dominated 



2 Much of this radiation may actually be in the form of X-rays from the unresolved base of the jets itself 



55 




Figure 30: Left: Fraction of radio loud objects (denned as objects with a radio luminosity larger 
than 10 125 WHz" 1 per solar mass o f stars of its host galaxy) plotted against stellar mass of the 
host, adopted from lBest et al.l (|2005l ): right: Radio loudness R' (here defined as 5GHz radio flux 
to 2500^4 flux) as a function of E ddington r atio A (defined as the ratio of bolometric AGN flux 
to Eddington flux) , adopted from |Hc] (|2002l ) . 



low-luminosity black hole. 

While a direct translation of radio loudness into feedback efficiency is challenging, this result 
suggests that black hole feedback might be more prevalent than just in the most powerful AGN 
in the most massive galaxies. In fact, the ubiquity of low-luminosity AGN, and their increased 
dominance at low redshift (see Fig. [HJ) su pports both the ide a of a radio maintenance mode of 
ongoing feedback in early type galaxies ( Croton et al. . 20061 ) , as well as the picture of gentle 
feedback (through buoyancy rather than shocks) not just in clusters but also in galaxies. 

Additionally, ongoing low-level jet activity seems much better suited at targeting gas within 
the galaxy than explosive outbursts in the form of powerful radio galaxies that would transport 
most of the energy far beyond galactic scales, and the prominent examples of radio mode feedback 
shown in Fig. [29] should be considered extreme outliers from more typical radio- mode feedback. 
This statement can, in fact, be quantified based on the global AGN evolutionary models outlined 
in chapter l3.1.1j, which we shall discuss next. 



4.5 Quantifying the efficiency of the radio mode 

The observed omni-presence of radio corea^l in low luminosity AGN and the observed increase 
in radio loudness of X-ray binaries at low luminosities can be placed on a solid theoretical 
footing. Jets launch in the innermost regions of accretion flows around black holes, and at low 
luminosities, these flows likely become mechanically (i.e., advectively) cooled. 

13 The "core" of a jet is the brightest innermost region of the jet, where the jet just becomes optically thin to 
synchrotron self absorption, i.e., the synchrotron photosphere of the jet. 
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Such flows can, to lowest order, be assumed to be scale invariant: a low luminosity accretion 
flow around a 10 solar mass black hole, accreting at a fixed, small fraction of the Eddington 
accretion rate, will be a simple, scaled down version of the same flow around a billion solar mass 
black hole (with the spatial and temporal scales shrunk by the mass ratio). It follows, then, 
that jet formation in such a flow should be similarly scale invariant. 

This assumption is sufficient to derive a very generic relation between the radio luminosity 
emitted by such a scale invariant jet and the total (kinetic and electromagnetic) power car- 
ried down the jet, indepe ndent of the unknown details of how jets are launched and collimated 
(|Heinz fc Sunvaevl . 1200.1 1: The synchrotron radio luminosity L u of a self-absorbed jet core de- 
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pends on the jet power Pj e t through 

17+8a 

iradio OC P jct 12 M" a ~PT5 (23) 

where M is the mass of the black hole and a ~ is the observable, typically flat radio spectral 
index of the synchrotron power-law emitted by the core of the jet. This relation is a result of 
the fact that the synchrotron photosphere (the location where the jet core radiates most of its 
energy) moves further out as the size scale and the pressure and field strength inside the jet 
increase (corresponding to an increase in jet power). As the size of the photosphere increases, so 
does the emission. The details of the power-law relationship are an expression of the properties 
of synchrotron emission. 

For a given black hole, the jet power should depend on the accretion rate as Pj c t oc M 
(this assumption is implicit in the assumed scale invariance). On the other hand, the emission 
from optically thin low luminosity accretion flows itself depends non-linearly on the accretion 
rate, roughly as L acc oc M 2 , since two body processes like bremsstrahlung and inverse Compton 
scattering dominate, which depend on the square of the density. Thus, at low accretion rates, 

^raHin ^ -^boi 1 which impl i es that black h o les sh o uld become more ra dio loud at lower luminosities 
(lllciiiz k Sunvaevl . 120031 : iMerloni et al.l . 120031 ; iFalcke et al.l . |2004j). It also implies that more 



massive black holes should be relatively more radio loud than less massive ones, at the same 
relative accretion rate M/M. 

Equation [23] is a relation between the observable core radio flux and the underlying jet power. 
Once calibrated using a sample of radio sources with known jet powers, it can be used to estimate 
the jet power of other sources based on their radio properties alone (with appropriate provisions 
to account, statistically, for differences in Doppler boosting between different sources). 

The cluster radio sources shown in Fig. [31] provide such a sample. Plotting the core (unre- 
solved) radio power against the jet power inf erred from cavity and sh ock analysis shows a clear 
non- linear relation between the two variables ( Merloni Sz Heinzl . 20071 ). Fitting this relation pro- 



vides the required constant of proportionality and is consistent (within the uncertainties) with 
the power-law slope of 17/12 predicted by eq. ([23]) 



/ T \ C / t \ °- 81 

P jtt _ Fo (^) „ , 6 „ 1 „3a ergas - 1 (-^) (24) 

with an uncertainty in the slope £ of 0.11, where £ r adio = vL v is measured at v = 5GHz. 

Because this relation was derived for the cores of jets, which display the characteristic flat 
self-absorbed synchrotron spectrum, care has to be taken when applying it to a sample of objects: 
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only the core emission should be taken into account, while extended emission should be excluded. 
As discussed in §2.1 . 1 1 radio luminosity functions are separated spectrally into flat and steep 
sources, and we can use both samples to limit the contribution of flat spectrum sources from 
both ends. 

Given a radio luminosity function <3? ra d and an appropriate correction fo r relativistic boost- 
ing, eq. I2H1 can be use d to derive the kinetic luminosity function of jets (jHeinz et al.l . 120071 ; 



Merloni fcHeind . l2008h : 
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The resulting kinet i c lumi nosit y functions for t he flat spectrum radio luminosity functional from 
Dunlop k Peacock! (jl990T ) and lde Zotti et al.l (120051 ) are plotted in the right panel of Fig. [3TJ 

Since the figure plots P ■ $p, the curves show directly the total contribution of AGN at a 
given jet power to the total feedback power at a given redshift. At the low luminosity end, these 
curves are roughly flat, implying that low luminosity source contributed a significant fraction 
of the total power. These are the low-luminosity AGN presumably responsible for radio mode 
feedback, and they dominate the total jet power output at low redshift. 

Integrating the luminosity function over Pj et gives the local jet power density ppjet, which, 
at redshift zero, is of the order of (ppjet) ~ 6 x 10 39 ergs s _1 Mpc -3 , which is comparable to 
the local power density from supernovae, but will be significantly above the supernova power in 
early type galaxies (which harbor massive black holes prone to accrete in the radio mode but 
no young stars and thus no type 2 supernovae). 

Finally, integrating <I>ki n over redshift gives the total kinetic energy density «pj e t released 
by jets over the history of the universe, upj c t ~ 3 x 10 57 ergs Mpc -3 . By comparing this to the 
local black hole mass density /jbh we can derive the average conversion efficiency r^j e t of accreted 
black hole mass to jet power: 

UPjet 



>1 



PBUC Z 



0.2% - 0.5% 



(26) 



In other words, about half a percent of the accreted black hole rest mass energy gets converted 
to jets, averaged over the growth history of the black hole. 

Since most black hole mass was accreted during the quasar epoch, when black holes were 
mostly radio quiet, about 90% of the mass of a given black hole was accreted at zero efficiency 
(assuming that only 10% of quasars are radio loud). Thus, the average jet production efficiency 
during radio loud accretion must be at least a factor of 10 higher, about 2%-5%, comparable to 
the radiative efficiency of quasars. These are exactly the kinds of efficiencies needed for radio 
mode feedback to work. 



4.6 Quasar mode feedback 

Arguments for black hole feedback on galactic scales stem primarily from three facts: 

• The d eviation of the bright end of the galaxy luminosity function from self-similar predic- 
tions ( Springel et al. . 20051 ) . that is, a dearth of bright galaxies. 



14 Comparison to the steep spectrum luminosity function shows that the error in $p from the sources missed 
under the steep spectrum luminosity function is at most a factor of two 
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Figure 31: Left: Red open circles show jet power (measured from X-ray cavities) plotted against 5 
GHz core radio luminosity (also shown in blue solid circles is a Doppler boosting corrected version 
of the same points) along the power-law fit given in eq. (|24p ; adopted from iMerloni &; Heinz 
( 20071 ): right: Kinetic jet luminosity function derived from flat spectrum (FS) radio galaxy 
surveys, for different redshift bins (green curve shows all radio sources, blue sh ows radio sources 
i n the radio mode, red shows radio sources in quasar mode); adopted from IMerloni fc Heinz 
(|2008h . 



The bimodality of the galaxy distribution in color-magnitude space (jStrateva et al.l . l200lh . 
with early type galaxies forming the "red sequence" and late type galaxies forming the 
"blue cloud". Between these two populations lies, naturally, the so-called "green valley", 
which is relatively sparsely populated. This bimodality is shown in Fig. [32j 

The tight relation between stellar bulge mass and black hole mass, which suggests a com- 
mon formation scenario. Given that massive black holes grew mostly as quasars during the 
epoch of star formation, this suggests a relationship between both. In fact, the argument 
for quasar mo de feedback was first made in part to mo tivate black hole - galaxy scaling 
relations (e.g. ISilk fc Eeesl . Il998l : Iwvithe fc LoebLl200al ). 



Rapidly growing black holes are attractive as agents of feedback on ongoing star formation 
because they have similar growth histories, they can be found in the centers of galactic bulges 
(the stellar populations their feedback is supposed to influence), they can release large amounts 
of energy isotropically, and they are likely to be fueled rapidly in response to galaxy mergers, 
which also trigger star formation. 

Numerical simulations of black hole feedback in individual galaxy mergers have produced 
impressive visualizations of how rapid, isotropic energy injection by a growing black hole can heat 
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and disperse the c ool, star forming gas, in essence explosively terminating star formation and 
black hole growth ( Di Matteo et al. . 20051 ), In part as a result of these successes, quasar mode 
feedback is now routinely incorporated int o cosmological simulations of stru c ture f ormation and 
semi analytic models of galaxy formation ( Croton et al. . 20061 ; Bower et al. . 20061 ). 

In these simulations the prescription of how black holes accrete is simplified to variations of 
the Bondi accretion rate, necessitated by the unresolvably vast dynamic range of the problem. 
Energy is injected isotropically, which is an appropriate zero order choice given our lack of 
knowledge about the actual channel through which the energy is delivered. What the simulations 
tell us is that efficient black hole feedback can regulate star formation and black hole growth. 
But because black hole feedback and supernova feedback are operationally very similar, and 
because the presumed AGN feedback mechanism is generic, it is difficult to extract more detailed 
information about the AGNs themselves from the models. 

In addition, the causality of the interaction of black holes with the star forming gas sur- 
rounding them is not yet fully established. It is also plausible that star formation itself provides 
the feedback through supernovae, and that competitive accretion starves both black holes and 
stars, leading to a passive link between black holes and stars. 

Identifying currently ongoing episodes of feedback has proven to be difficult, in part because 
of the large degrees of visible- and soft X-ray extinction towards star forming regions and because 
of the small angular scales involved. Proving the causal connection between AGN activity and 
terminated star formation is even more difficult. 

Generally, one would assume that galaxies caught in the act of feedback should just start 
their transition from the blue cloud to the red sequence, as the population of recently formed 
early stars fades without any replenishment. The relative under-density of galaxies in the green 
valley suggests that this transition is a relatively rapid process (one would expect it to occur 
roughly on A-star life times). 

Stellar population modeling has successfully been used to identify such post-starburst galax- 
ies. And indeed, sources have been fo und among this class that show clear evidence for very 
fast outflows in excess of 1000 km s" 1 ( Tremonti et al.l . 120071 ) that might be the smoking gun. 
Estimating the mass in the outflow has proven to be difficult, and we have to await deep imaging 
that can directly resolve the outflow to quantify the energetic impact of the AGN on the galactic 
gas. 

In addition, surveys of (hard) X-ray selected AGN fin d these sources t o prefe rentially lie 
in the green valley (from the all-sky Swift-BAT survey; Schawinski et al. . 20091 ) . as can be 



seen in Fig. [32j Since AGN accretion time scales can be expected to be shorter than the 
transition time across the green valley, this observation suggests that the AGN activity comes 
after star formation has been terminated. Since this is true also for hard X-ray selected AGN, 
this conclusion should not be affected by obscuration unless AGN in the act of feedback are so 
heavily obscured that even Swift cannot detect them. 

Thus, the question of what is at the heart of the putative quasar mode feedback is left 
unanswered. Generally, AGN can release energy via three channels: Through radiation, through 
jets, and through un-collimated outflows (i.e., "winds"). 

The most obvious source of feedback energy in efficiently accreting black holes is, of course, 
the radiation itself. Since most bright AGN are obscured, we can infer that a high fraction of the 
initially emitted light is reabsorbed by the surrounding gas. If some of the energy is deposited on 
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Figure 32: Contours of galaxy counts as a function of R-band magnitude and g-r color, showing 
the existence of two separate populations - the red sequence on top and the blue cloud on 
the bottom. Over-plotted are the locations of X-ray selected AGN (hard and soft), with a 
clear preference for a lo cation in the "green valley" in between both populations; adopted from 
Schawinski et al.1 (l2009h . 



sufficiently large scales (rather than into gas bound to t he black hole), it can in principle supply 
the e nergy for feedback. Models of radiative feedback (jCiotti &: Ostrikerl . l200ll ; ISazonov et al 



20051 ) generally rely on Compton heating. The efficiency of radiative feedback requires about 



10% of the radiation to be absorbed on scales outside of the Bondi radius but within the star 
forming region of the host. Whether radiative transfer will always conspire to provide such an 
arrangement is an open question. 

Efficiently accreting AGN (quasars and Seyferts) are also known to generate massive winds: 
Optical absorption line studies show outflows at velocities of thousands of kilometers per second. 
The most dramatic demonstration comes from the class of broad absorption line quasars (BAL 
QSOs), which show high column densities of absorption in visible and X-rays (indicating high 
mass fluxes) and wind velocities up to 50, 000 km s -1 . 

If column density measurements made in the X-ray band trace the same gas that produces the 
large outflow velocities in optical absorption lines, the power and mass cont ained in these winds 
woul d be of the same order as the total radiative power of these objects ( Furlanetto Sz Loebl . 
booih . Driving such a wind would presumably require some form of mechanical input (for 
example, from magneto-centrifugal launching as described in chapter "Active Galactic Nuclei" 
by E. Permian in this same volume) in addition to radiative driving. 

The ubiquity of outflow signatures in efficiently accreting AGN, coupled with the large wind 
efficiencies inferred from the more ex treme cases, have made AGN winds the primary mechanism 
invoked in feedback models (see e.g. iKind . 120051 ). Given the uncertainties in column density of 
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the high-velocity gas, a direct imaging detection of outflow signatures (like the cavities in the case 
of AGN feedback in clusters) would provide more certainty that winds can affect the surrounding 
gas on the scales needed for feedback to operate. 

The uncertainty about whether winds are powerful enough to drive feedback raises the in- 
teresting question whether episodes of powerful jet activity in quasars can lead to feedback on 
galactic scales, and whether they can be observed. In the simple framework of radio source 
dynamics laid out in §4.2.11 an episode of jet activity will inflate a supersonically expanding 
cocoon, the size scale of which depends on the jet power and the density of the environment. 

In the dense environments of star forming regions, one might thus expect sources to go 
through a compressed evolution, with slowed or even stalled expansion as sources run into dense 
gas. In such a scenario, the initial expansion might produce strong shocks (given the cold 
gas they encounter) but at much reduced shock temperatures given the slower expansion. Is 
it possible that powerful radio sources in dense environments can heat the gas sufficiently to 
provide the quasar mode feedback postulated by semi-analytic models? 

Given that about 10% of all powerful quasars are radio loud, and given that the required 
average feedback efficiency for the quasar mode can be an order of magnitude lower still, jet 
powered feedback may actually contribute significantly to the quasar mode as well. In fact, a 
class of sources that might represent these powerful radio quasars in the act of feedback exists 
in the s o-called Com pact-Steep-Spectrum (CSS) and the Gigahertz-Peaked-Spectrum (GPS) 
sources dO'Deal . flifflsh . 



These are small scale radio sources that show clear signs of strong absorption to the radio 
spectrum (indicating a high local pressure and thus ISM density) and otherwise appear similar to 
classical radio sources but on smaller scales. The cause for their compactness has been debated 
since their discovery: They might be young sources, in the very early stages of supersonic 
expansion, or frustrated older sources, caught in very dense environments. In either case, this 
would be a population of sources directly heating the dense gas in the centers of galaxies, where 
quasar mode feedback is observed. 

Recent evidence does suggest tha t these sources are indeed young, and that we are lo oking 
at infant powerful radio sources (e.g. Holt et al. . 2008 : Kunert-Bajraszewska et al. . 2010l ). The 



high rate of incidence, compared to bona fide quasars, suggests that they are a short-lived 
phenomenon, which would make them effective short-cycle thermostats in a feedback scenario. 

The detection of compact radio sources in high-redshift star forming environments seems to 
support the role of jets in quasar mode feedback: A number of high-power compact radio sources 



have been found in actively star forming regions with powerful outflows (INesvadba et all 120071 . 
l201lh and in dense, high-z cooling flow environments (jSiemiginowska et all bold ). Because we 
know jet feedback works in the context of clusters and likely in the "maintenance" mode of 
feedback, and because we know that CSS and GPS sources are (a) frequent and (b) powerful, 
they present an attractive alternative to the wind-driven QSO mode of feedback. 

Simulations of jets in dense, multi-phase environments, as might be expected in star form- 
ing galaxies, already show significant promise in solving the question of how bipolar, highly 
collimated jets in even ve ry powerful radio sources could efficiently heat the gas in galaxies 
(jWagner fc Bicknelll . lioill v 
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5 Cosmogony 



We have seen in section lBTTI that the total mass density estimated in relic supermassive black holes 
at z ~ is consistent with the total mass accreted by growing black holes during (obscured and 
un-obscured) AGN phases for a radiative efficiency of the accretion process (0.06 < e ra d < 0.2, 
depending on the bolometric corrections and local mass dens ity exact estimate), well in line with 
the prediction of classical relativ istic accretion disc models ([Novikov &: Thornd . [l973h . 

In fact, the validation of the SoltanI ( 1982 ) argument implies that the last few e- folds of a 
SMBH's mass are mainly grown via (radiatively efficient) classical accretion discs, rather than 
through mergers or radiatively inefficient accretion. If this is true, however, the very process of 
cosmological black hole growth through accretion quickly erases the initial condition, namely, 
the primordial mass function of seed black holes, making it almost impossible to deduce the 
physical properties of early black hole formation from observations probing redshifts smaller 
than that corresponding to the most efficient growth (z ~ 2 — 3). That is, unless a specific 
range of BH masses is identified which is less affected by the complex process of AGN activation 
during structure formation. 

Indeed, some have argued that small mass black holes in isolated, small mass galaxies could 
have maintained a 'memory' of the seeding mechanism (in their location with respect to the 
scaling relations defined for more massive systems, for example), being less affect ed by the 
mult iple generations of hierarchical mergers in the emerging cosmic web (see e.g. IVolonteri 
2Q10h . Very few observational constraints are available for this class of ob jects, however. 

On the other hand, the observation of luminous quasars at z ~ 6 (e.g. 
shown that it is possible to probe directly the earlier epochs of massive black hole assembly, and 
thus to try to directly constrain the various physical processes responsible for planting the seeds 
that grow into the giant monsters in the nuclei of galaxies. 



Fan et al.l . l200ll ) has 



5.1 The first black holes: observational constraints and theoretical ideas 

The observed luminosity functions of AGN suggest a rapid decline of the total luminosity density 
above z ~ 3 (see Figure [TH]) . At face value, the constraints on the very high redshift evolution of 
the population at z > 5 come primarily from bright optical quasars detected in very large area 
surveys, bu t recent indications from large area and moderately deep radio (jWall et al.l . 120051 ) 



and X-ray ( Civano et al. . 201 ll ) surveys do provide a consistent picture for the evolution of the 
most luminous AGN over all observational wavebands (Figure [33]) . 

The observed rapid decline of QSO number density towards high redshift translates into a 
rapid decrease in the number of AGN-generated ionizing photons towards the end of the re- 
ionization epoch. Accurate determination of the QSO rest-frame UV luminosity function are 
thus crucial to assess the role of growing black hole might have played in re-ionizing the universe. 
Current estimates suggest that galaxies do dom inate the comoving emiss ivity of ionizing photons 
escaping in the inter-galactic medium at z > 4 ( Haardt fc Madau . 20121 . and references therein). 

Despite their rarity, very high-redshift QSOs can provide interesting constraints on the early 
evolution (and even formation mechanisms) of nuclear supermassive black holes. The high 
metal enrichment observed in high-z AGNs (see section II. ip , even in those close to reionization 
{z ~ 6), indicate that the host galaxies of these AGNs must have undergone a powerful and 
rapid burst of star formation. And indeed, vigorous star formation is observed in such high-z 
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Figure 33: Observational constraints on the decline of QSO number densities at high redshift. 
Left: Relative space density of QSOs (p) as a function of redshift. The shaded area and black 
line represent the current QSO space-density determination from the Parkes quarter-Jansky 
flat-spectrum sample of radio selected QSOs. Light blue filled and dark blue open circles show 
the soft X-ray data from ROSAT, Chandra and XMM-Newton surveys. Space density behavior 
of optically-selected QSOs is given by the set of dark red triangles. The X-ray and optical QSO 
data were scal ed verticall y to m atch the current determination of space density at redshifts 2 
to 2.5. From IWall etHl (j2005h . Right: The comoving space density at bright 2-10 keV X- 
ray luminosity from the Chandra-COSMOS survey, computed taking into account the effect of 
obscuration. The blue curve corresponds to the Xray selected AGN space density computed for 
the same luminosity limit from models of the CXRB. The yellow shaded area represents the 
maximum and minimum spac e dens ity. The green symbols correspond to the data of XMM- 



COSMOS. From lCivano et all fooilh . 
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quasars, as inferred from the detection of prominent PAH (Polycyclic Aromatic Hydr ocarbons) 
featu res, strong far-IR emission and from the detection of the [CII]158m line (see iMaiolinol . 
20081 ). redshifted to millimeter wavelengths. Most likely, we are witnessing the coeval, rapid 
formation of massive bulges along with their supermassive central black holes. 

These luminous quasars detected at z > 6, when the universe was less than 1 Gyr old 
have estimated BH masses (from the "virial method") in excess of ~ 10 9 Mq, and it is by no 
means a trivial task to grow such massive holes in the relatively short time available. Assuming 
continuous growth at an Eddington ratio of A = L/L^d'- 

= (1 - e rad )A x L Edd /(e rad c 2 ) (27) 
we have, for the final BH mass as a function of the initial mass 



M B n,f(t) = Mi exp (1 - e rad )/e rad x (V T sai P ) , 
where we have defined the typical e-folding time (the so-called "Salpeter time") as 



7"salp 



0.45 



A > Gyr 



(28) 



(29) 



Depending on the redshift of formation of the seed of mass , and on the average radiative 
efficiency of the accretion pro cess, only a lim ited range of final BH masses can be reached at 
z = 6, as shown in Figure [Ml dShapirol . 120051 ). If the BH seed masses are in the range expected 
from Pop III remnants, of the order of a few hundred solar masses, then highly radiative efficient 
(^rad > 0.1) accretion is excluded, as it would not allow enough mass to be accumulated into 
the black hole rapidly enough. 

Such a scenario has a number of major difficulties. First of all, if the accretion is indeed 
continuous and proceeds at high Eddington rates, the accretion flow should form a geometrically 
thin, optically thick disk. If this is the case, even a black hole with zero initial dimensionless 
angular mome ntum dj = wi ll be rapidly spun-up by the angular momentum captured with the 
accreting gas. Bardeen (jl970l ) has shown that in this case the final spin obeys: 



,V2 



a f 



i Mi 



3 M 



f 



3r n 



Mi 



M 



(30) 



where r mSi ; is the radius of the marginally stable orbit of the initial black hole (itself a monotonic 
function of spin, with r ms (a = 0) = 6 and r ms (a = 1) = 1 in gravitational units). Thus, 
an initially non-spinning BH is spun up by accretion of gas in a classical geometrically thin 
and optically thick accretion disc as soon a M f /Mi = VQ- Since an accretion disc around 
a maximally rotating hole will radiate with an efficiency e rad = 0.42, we are left with the 
impossibility of growing black holes larger than a few thousands of solar masses via prolonged 
coherent accretion onto a stellar mass seed (see Figure l34"l) . 
A few solutions have been proposed to the above problem. 



15 Note that the above c alculation assumes that there is no torque at the inner boundary of the accretion disc 
(jNovikov fc Thornd . Il973h . Magnetic linkage between the disc, the plu nging region and t he event horizon can 
modify the above picture, reducing the maximal spin a BH can reach jKrolik et all 120051 ). Nonetheless, most 
numerical models of geometrically thin magnetized discs are still consistent with a rapid spin of the BH. 
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Figure 34: Ratio of final-to-initial black hole mass at z = 6 calculated from eq. (|28p assuming 
A = 1 (i.e. continuous Eddington-limited accretion) as a function of the formation redshift of 
the seed black hole. Each solid curve is labeled with the corresponding value of the radiative 
efficiency e ra d- Dotted horizontal lines show the ratio implied by the observed z ~ 6 QSOs for 
massi ye seeds, while the dashed ones that for stellar mass (Pop III; see section [57T1 for details). 
From lShapirol (|2005l ). 



1. First, accretion might not be coherent, but rather stochastic, such that the accreting gas 
comes into the gravitational sphere of influence of the black hole in parcels with randomly 
oriented angular momenta. If the mass of each parcel is small enough (roughly speaking, 
if AM <C V6Mi), then the BH spin vector performs a random walk, but as it is easier 
to spin a black hole down than up, the net effect is a rel atively low average sp in (and 
correspondingly lower radiative efficiency) of the final hole ( King fe Pringle . 20061 ) . 



2. In the primordial cosmological setup where proto- galaxies form, the first black holes grow 
in a very gas rich environment, and there is no reason to believe that the gas could not 
flow towards the central black holes at vastly super-Eddington rates. It is not clear, 
however, whether the hole can swallow matter that fast. On the one hand, quasi-spherical 
inflows can be established, where the radial velocity of the accreting ga s is so high that th e 
photons produced inside the disc by the viscous torques cannot escape (jFrank et alll2002h . 



In those cases, although the emerging luminosity is at most logarithmically in excess of 
the Eddington limit, the accretion rate onto the hole can be orders of magnitude larger. 
On the other hand, the accretion flow can start blowing out matter at the (large) radius 



wher e the locally produced energy exceeds the local Eddington limit (IShakura fc Sunyaevl . 



1973 ). A powerful wind ensues, which may prevent the mass accretion rate onto the black 



hole from exceeding the Eddington limit by more than a factor of a few. 

3. Black hole seeds in the early universe can be more massive than the remnants of Pop 
III stars. These would have formed by direct collapse of primordial massive stars (see 



GO 



e.g. IVolonterl l20ich . For example, some theoretical models have argued that the gas 
chemistry in the most massive, hottest primordial DM halos can prevent fragmentation of 
the cooling gas and lead to the formation of very massive stars. Their cores will rapidly 
collapse, leaving a black hole at the center of a quasi-static, radiation pressure-supported 
supermassive star. The resulting object, called a quasistar, resembles a red giant with a 
luminosity comparable to a Seyfert nucleus. The black hole grows inside it until the cooling 
photosphere can no-longer sustain its own radiation pressure and the envelope dis perses, 
leaving behind the naked seed black hole of typically 10 4 -10 5 Mq ( Begelman . 2O10l ). 



Finally, a large number of major mergers could help relax the demands on the efficiency 
and stability of gas accretion on the first black holes by enhancing the final-to-initial mass 
ratio by a factor of the order of the number of equal- mass (or major) mergers along the 
main tree of the hierarchy. 



Cosmological numerical simulations (|Li et all 120071 ) provide a possible route to the for- 
mation of a 10 9 Mq at z ~ 6 by starting with Pop III stellar mass seeds at z ~ 30 which 
experience an early phase of continuous, Eddington-limited accretion (subject, however, to 
the limitations discussed above), before entering the merger tree at z ~ 14, where a large 
number of major merger events is able to accumulate the final mass, even in the presence 
of AGN feedback. 



Analytic and semi-analytic models of the early assembly of massive black holes that include 
(with varying degrees of sophistication) the many competing processes (mergers, gravitational 
wave recoil and nuclear black hole ejection, dynamical friction on wandering BHs, pristine gas 
accretion, etc.) make clear predictions for the early seed mass distributions, the initial conditions 
for SMBH growth that we would like to probe. Figure [35] shows one such prediction, comparing 
the outcomes of three different formation scenarios: direct collapse, runaway stellar mergers in 
high-redshift stellar clusters, and Population III remnants. A more complete census of the AGN 
population at z ~ 6 or even a few detections of z ~ 10 AGN with the next generation of large 
astronomical facilities could provide direct means to distinguish among these simple formation 
scenarios, allowing us to glimpse into the obscured epoch when the first nuclear black holes 
formed. 
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Figure 35: Mass function of seed massive Black Holes for three different formation scenarios: 
direct collapse (left), runaway stellar mergers in high-redshift stellar clusters (center) and Popu- 
lation III remnants (right). Note the different y-axis scale for the Pop III case. From (jVolonteril . 
20ld ). 
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